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SUMMARY 


This  report  describes  the  use  of  an  external  statisti- 
cal analysis  package  to  analyze  SAINT  output.  SAINT 
(Systems  Analysis  of  Integrated  Networks  of  Tasks)  is  a 
package  of  computer  routines  designed  to  aid  the  system 
designer  and  human  engineer  in  analyzing  complex  man- 
machine  systems.  It  provides  the  conceptual  framework 
which  allows  the  development  of  system  models  in  which  men, 
machines,  and  the  environment  are  represented.  It  permits 
the  assessment  of  the  effect  of  the  component  characteris- 
tics of  the  system  on  overall  system  performance.  The 
symbolism  and  terminology  required  for  modeling  systems 
using  SAINT  are  introduced  and  described  in  Simulation 
Using  SAINT:  A User-Oriented  Instruction  Manual  (1) . The 
procedures  for  using  the  SAINT  simulation  program  to  analyze 
system  models  is  described  in  The  SAINT  User's  Manual  (2) . 
The  overall  structure  and  individual  FORTRAN  subprograms  of 
SAINT  are  described  in  Documentation  for  the  SAINT  Simula- 
tion Program  (3) . 

In  this  report,  the  methodology  required  to  perform  a 
statistical  analysis  of  SAINT  output  using  the  SPSS  sta- 
tistical package  is  illustrated.  A remotely  piloted 
vehicle/drone  control  facility  (RPV/DCF)  system  in  which 
five  RPVs  fly  along  a flight  path  to  a target  under  the 
control  of  a single  operator  DCF  is  hypothesized.  A SAINT 
model  of  this  system  is  developed  and  documented.  Execu- 
tion of  the  SAINT  model  causes  the  preparation  of  a file 
of  data  that  can  be  directly  input  to  the  SPSS  statistical 
routines.  With  these  data,  the  SPSS  package  is  used  to  per- 
form statistical  analyses  relating  to  the  operation  of  the 
hypothesized  RPV/DCF  system. 

The  RPV/DCF  system  hypothesized  and  the  analyses  per- 
formed in  this  report  are  designed  solely  for  illustrative 
purposes.  The  RPV/DCF  system  does  not  represent  any  existing 
or  planned  real-world  system.  The  analyses  are  not  intended 
to  be  comprehensive.  However,  the  techniques  described  here 
can  be  used  to  set  up  statistical  analyses  for  outputs  from 
any  SAINT  model. 
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SECTION  I 


INTRODUCTION 


Simulation  programs  produce  output  data  that  frequently 
require  additional  statistical  analysis.  The  SAINT  program 
is  an  example.  Since  packages  of  statistical  routines  are 
available,  it  appears  desirable  to  provide  an  interface  be- 
tween SAINT  output  data  arrays  and  these  analysis  packages. 

The  mechanism  to  achieve  this  interface  has  been  de- 
signed into  SAINT  through  subroutine  ENDIT.  With  this  sub- 
routine, the  user  can  communicate  SAINT  data  structures  to 
any  set  of  analysis  routines  without  modifying  or  recoding 
the  existing  routines  of  the  statistical  package.  In  this 
manual,  the  statistical  computer  package  SPSS,  Statistical 
Package  for  the  Social  Sciences,  is  used  in  conjunction  with 
a SAINT  model  to  illustrate  the  interface. 

SPSS'*'  is  an  integrated  system  of  computer  programs  for 
use  in  the  analysis  of  scientific  data.  The  system  provides 
a comprehensive  package  that  enables  the  user  to  perform 
various  types  of  data  analysis.  Among  the  statistical 
capabilities  provided  by  SPSS  are: 

1.  data  transformation 

2.  file  manipulation 

3.  descriptive  statistics 

4.  simple  frequency  distributions 

5.  cross  tabulations 

6.  simple  correlation 

7.  partial  correlation 

8.  means  and  variances  for  stratified  subpopulations 

9.  one-way  and  n-way  analysis  of  variance 


^All  information  concerning  SPSS  used  in  this  example  is 
described  fully  in  reference  material  (4). 
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10.  multiple  regression 

11.  discriminant  analysis 

12.  scatter  diagrams 

13.  factor  analysis 

14.  canonical  correlations 

15.  Guttman  scaling 

The  SPSS  capabilities  employed  for  the  analysis  of  the  example 
SAINT  model  are  directly  related  to  the  objectives  of  the 
modeling  effort.  These  objectives  and  the  SPSS  procedures 
will  be  defined  in  later  paragraphs. 

To  illustrate  the  SAINT-SPSS  interface,  a SAINT  model 
of  a hypothetical  mock-up  of  a drone  control  facility  (DCF) 
in  which  one  operator  monitors  and  controls  the  flight  of 
five  remotely  piloted  vehicles  (RPVs)  is  employed.  The 
RPV/DCF  system  modeled  is  a simplification  of  the  real-world 
RPV/DCF  system  that  has  been  postulated  by  the  Aerospace 
Medica^  Research  Laboratory  (AMRL)  of  the  United  States  Air 
Force.  This  simplified  model  is  used  so  that  the  SAINT-SPSS 
interface  can  be  clearly  presented  and  described  free  from 
any  possible  confusion  that  is  attendant  to  a discussion  of 
a complex  model.  However,  the  procedures  for  providing  the 
interface  are  applicable  to  any  model  independent  of  size 
and  complexity. 

The  purpose  of  this  study  is  to  demonstrate  the  total 
SAINT  simulation  process,  including  a description  of  the 
system  to  be  modeled,  the  development  of  the  SAINT  model,  the 
coding  of  the  input  data,  and  the  SPSS  analysis  performed  on 
the  outputs.  This  translates  into  the  following  objectives: 

1.  To  provide  an  example  illustrating  both  the 
application  of  SAINT  modeling  concepts  and 
preparation  of  the  input  data. 

2.  To  exercise  the  SAINT  model  and  produce  out- 
puts of  performance  and  design  measures  in  a 
form  that  is  acceptable  as  SPSS  input. 

3.  To  analyze  these  outputted  variables  using 
SPSS  to  determine  relationships  between  system 
design  and  system  performance. 
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The  postulated  real-world  system  is  described  in  detail  in 
reference  material  (5,6,7),  as  is  the  SAINT  model  of  the 
RPV/DCF  real-time  simulation  of  the  postulated  system  (8,9). 


SECTION  II 


RPV/DCF  SYSTEM 
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Figure  1 is  a pictorial  description  of  the  RPV/DCF 
system.  As  the  RPVs  fly  from  launch  to  target,  two  com- 
munication links  will  exist  between  the  operator  at  the 
DCF  and  each  RPV.  The  position  reporting  data  link  (PR) 
reports  the  position  of  the  RPV  to  the  DCF  operator.  The 
command  data  link  (CL)  transmits  commands  from  the  DCF 
operator  to  the  RPV.  PR  and  CL  information  is  passed  be- 
tween the  RPV  and  DCF  through  a relay  aircraft  to  overcome 
terrain  interference.  These  links  transmit  messages  every 
five  seconds  without  any  communications  error. 

All  five  RPVs  of  the  mission  are  "strike"  RPVs  that 
will  deliver  their  payload  at  the  time  that  they  achieve  the 
target.  The  first  RPV  will  be  launched  at  time  five  sec- 
onds and  the  others  at  five  second  intervals  from  this  time. 

The  RPVs  will  perform  the  mission  without  suffering  any 
adverse  effects  from  faulty  equipment  or  enemy  defenses, 
and  it  is  assumed  that  sufficient  fuel  is  available  to  com- 
plete their  flight. 


RPV  Flight 

The  RPVs  fly  from  launch  to  target  along  a flight  path. 
The  flight  path  flown  by  all  RPVs  is  depicted  in  Figure  2 
and  defined  in  Table  1.  Upon  achieving  the  target,  T,  the 
RPV  will  automatically  deliver  its  payload  and  return  to  the 
launch  site  for  recovery  without  any  direction  from  the 
DCF.  The  flight  of  the  RPVs  along  their  flight  paths  or 
along  a directional  patch  (heading  change)  requested  by  the 
operator  is  linear  from  point  to  point  on  the  flight  path  or 
patch. 

In  flight,  the  RPVs  are  to  maintain  an  altitude  of  200 
feet  and  a velocity  of  400  knots.  The  navigation  systems 
on-board  the  RPVs  will  maintain  the  altitude  of  200  feet 
without  error;  however,  they  will  not  maintain  the  command 
velocities  of  400  knots,  and  the  true  velocity  will  vary 
around  this  value. 

In  addition  to  velocity  or  "ground  speed"  errors,  the 
navigation  system  will  produce  directional  or  "ground  course" 
errors.  Thus,  the  RPVs  will  deviate  from  their  flight  paths 
and  require  external  monitoring  by  the  DCF. 
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To  report  RPV  flight  deviation  to  the  DVF , flight  path 
position  variables  are  defined.  The  position  where  the  RPV 
would  be  if  it  was  on  the  original  flight  path  is  defined 
as  the  VFPPE  position.  The  actual  position  of  the  RPV  is 
defined  as  the  TRUE  position.  The  deviation  of  the  RPV  from 
the  flight  path  is  then  computed  by  constructing  a line  per- 
pendicular to  the  flight  path  through  the  TRUE  position. 

Call  XX  the  point  of  intersection  of  this  line  with  the 
flight  path.  The  "cross  track  error"  or  "lateral  direction" 
of  the  RPV  is  then  the  distance  between  XX  and  the  TRUE 
position.  The  "ground  speed  error"  of  the  RPV  is  the  dis- 
tance between  XX  and  the  VFPPE  position. 

In  addition  to  the  TRUE  and  VFPPE  position  of  the  RPV, 
the  FPPE  position  of  an  RPV  is  defined.  Since  the  DVF 
operators  can  make  adjustments  to  the  flight  of  RPVs , the 
RPVs  will  navigate  according  to  these  adjustments  and  not 
according  to  the  original  flight  path.  The  FPPE  is  thus 
defined  as  the  position  where  the  RPV  would  be  if  it  was  on 
the  revised  flight  path.  (The  RPV  will  deviate  from  these 
adjustments  depending  on  the  accuracy  of  the  navigation 
systems.)  Once  the  RPV  has  navigated  the  adjustment  to  the 
flight  path  or  "patch"  specified  by  the  DCF  operator,  the 
FPPE  and  VFPPE  positions  are  identical. 


DCF  Operation 

The  DCF  operator  will  monitor  the  status  of  the  mission 
through  the  use  of  a visual  CRT  display  of  RPV  flight.  The 
CRT  display  is  depicted  in  Figure  3.  It  consists  of  a request 
block  and  two  information  blocks  which  can  present  RPV  status 
every  five  seconds.  In  the  status  block,  the  operator 
receives  the  current  value  of  the  lateral  deviation  of  an 
RPV  from  its  flight  path.  The  patch  block  presents  a lOnm  x 
lOnm  view  of  the  true  and  desired  (VFPPE)  flight  path  posi- 
tions of  an  RPV  centered  around  the  VFPPE.  The  operator 
uses  this  block  to  request  a directional  change  (patch)  to 
an  RPV.  The  request  block  is  used  by  the  operator  to  control 
the  two  information  displays. 

The  request  block  consists  of  two  squares,  labeled 
"STATUS"  and  "PATCH",  and  five  circles  labeled  by  RPV  number 
that  are  all  recognized  by  the  CRT  console  when  indicated 
by  a light  pen  of  the  DCF  operator.  To  request  the  status 
of  an  RPV,  the  operator  light  pens  "STATUS"  and  light  pens 
the  number  of  the  RPV  for  which  he  requests  the  status.  To 
patch  an  RPV,  the  operator  light  pens  "PATCH",  light  pens 
the  RPV,  waits  for  the  patch  display  to  be  presented,  and 
light  pens  the  flight  path  of  the  RPV  shown  in  the  patch 


13 


PATCH  DISPLAY 


True  Position  of  RPV 


VFPPE  Position  of  RPV 


Flight  Path  of  RPV 


RPV  NUMBER  = 

STATUS 

.1 

LATERAL  DEVIATION  = 

FEET 

□ 

.2 

.3 

□ 

PATCH 

.4 

• 5 

STATUS  BLOCK  REQUEST  BLOCK 


«. 

I 


Figure  3.  CRT  Display. 
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display  three  dots  ahead  of  the  VFPPE  of  the  RPV  (dots  are 
spaced  at  one  nautical  mile  intervals) . (For  an  RPV  not  cur- 
rently in  flight,  the  circle  for  this  RPV  is  not  presented 
to  the  operator.) 

The  operator  is  required  to  keep  the  RPVs  on  course 
until  they  reach  the  target,  and  he  accomplishes  this  by 
patching  an  RPV  via  the  CRT  console  when  he  determines  that 
the  RPV  is  too  far  off  course.  The  procedures  that  the 
operator  is  required  to  use  in  performing  a mission  are: 

1.  Continuously  consider  the  RPVs  that  are  in 
flight  in  numerical  succession  beginning  with 
RPV  1 . 

2.  For  the  RPV  being  considered,  obtain  the 
status  display. 

3.  From  this  display,  determine  if  the  lateral 
deviation  of  the  RPV  is  greater  than  the 
control  criterion,  x (the  lateral  deviation 
of  the  RPV  above  which  the  operator  is  re- 
quired to  patch) . 

4.  If  it  is,  request  the  patch  display  for  this 
RPV;  otherwise  consider  the  next  RPV. 

5.  Determine  if  there  is  a turn  on  the  screen 
within  the  next  five  miles  (the  patch  display 
will  not  appear  if  this  is  the  case,  it  will 
print  "TURN  PENDING  ON  FLIGHT  PATH"). 

6.  If  there  is,  consider  the  next  RPV,  other- 
wise, patch  the  RPV. 

The  operator  of  the  DCF  performs  the  above  procedure 
as  designed,  except  for  one  case.  Occasionally  (Y  percent 
of  the  time) , he  does  not  request  the  patch  display  (Step  4) 
when  the  lateral  deviation  in  the  status  block  is  in  fact 
greater  than  X. 

Since  the  operator  is  not  concerned  with  the  times  of 
arrival  of  the  RPVs  at  the  target,  he  is  not  required  to 
make  any  velocity  changes.  The  patches  made  by  the  operator 
require  only  one  point  as  the  computer  calculates  the  turn 
and  rolls  out  required  by  the  RPV  to  achieve  the  requested 
point  (or  reconnect) . 

I 
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Command  Processing 

Whenever  the  operator  inputs  a patch  command,  the  com- 
mand is  delayed  until  the  second  five  second  interval  fol- 
lowing its  input.  When  this  time  occurs,  the  command  is 
processed  and  sent  to  the  RPVs. 
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SECTION  III 


OBJECTIVES 


As  indicated  previously,  the  purpose  of  this  study  is 
to  demonstrate  how  SPSS  routines  can  be  used  to  process  the 
output  of  a SAINT  simulation  to  facilitate  the  analysis  of 
results.  The  SAINT  model  will  output  performance  and 
design  measures  in  a form  acceptable  as  SPSS  input.  SPSS 
will  then  be  used  to  analyze  these  outputted  variables  and 
to  determine  relationships  between  system  design  and  system 
performance. 

The  system  will  be  evaluated  based  on  the  average 
linear  distance  between  the  RPV  and  the  target  at  the  time 
the  RPVs  deliver  their  payload.  In  addition,  the  following 
performance  measures  will  be  considered  in  the  analysis. 

1.  Average  cross  track  error  of  the  RPVs  during 
their  travel  to  the  target,  sampled  every 
five  seconds  for  those  RPVs  in  flight. 

2.  Average  ground  speed  error  of  the  RPVs  during 
their  travel  to  the  target,  sampled  every  five 
seconds  for  those  RPVs  in  flight. 

As  implied  in  the  discussion  of  the  model,  the  follow- 
ing variables  will  be  treated  as  experimental  design  vari- 
ables and  used  for  the  analysis: 

1.  Navigation  System  Type. 

2.  X,  the  control  criterion  which  determines 
when  the  operator  is  required  to  patch. 

3.  Y,  the  probability  that  the  operator  will 
patch  an  RPV  when  he  notices  that  the 
lateral  deviation  of  an  RPV  is  greater  than 
X. 

The  analysis  to  be  performed  using  the  model  attempts 
to  determine  the  following: 

1.  If  the  operator  can  follow  the  operational 
procedures : 

a.  What  navigation  system  type  should  be 
supplied  to  the  RPVs? 


JL 
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b.  What  control  criterion  should  the  operator 
employ  in  patching  RPVs  (the  value  of  X)? 

2.  For  the  model  specified  above: 

a.  Does  operator  conscientiousness  (as 
described  by  Y)  affect  mission  per- 
formance? 

b.  Do  the  two  performance  measures  out- 
lined above  predict  mission  perform- 
ance? 
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SECTION  IV 


METHODOLOGY 


The  first  stage  of  the  analysis  will  examine  the  choice 
of  navigation  systems.  Two  navigation  systems  are  available 
for  RPVs.  Navigation  System  A,  a dead  reckoning  basic 
system,  produces  a speed  error  on  the  RPVs  that  is  normally 
distributed  with  a mean  of  0 knots  and  a standard  deviation 
of  10  knots.  The  ground  course  error  resulting  from  this 
type  of  navigation  system  is  also  normally  distributed  with 
mean  of  0 and  a standard  deviation  of  .035  radians.  Navi- 
gation System  B,  an  inertial  system,  causes  speed  errors 
that  are  normally  distributed  with  a mean  of  0 and  a 
standard  deviation  of  2 knots;  it  produces  normally  dis- 
tributed ground  course  errors  with  a mean  of  0 and  a star  dard 
deviation  of  0.005  radians. 

From  an  economic  point  of  view,  a dead  reckoning  basic 
system  is  preferred  to  an  inertial  system.  Thus,  unless 
there  is  a statistically  significant  difference  in  the  per- 
formance due  to  these  two  systems,  the  basic  system  will  be 
selected.  To  test  for  this  significance,  an  Analysis  of 
Variance  (ANOVA;  is  to  be  performed.  ANOVA  is  used  to 
test  for  statistically  significant  differences  between  design 
variables  ("treatments").  In  this  case  a completely  ran- 
domized design  with  four  replications  per  cell  will  be  used 
to  test  for  navigation  system  differences  at  the  two  fixed 
navigation  system  levels,  A and  B,  and  at  control  criterion 
levels  (X)  of  0 and  1000  feet.  The  ANOVA  analysis  will 
indicate : 

1.  If  there  are  significant  differences,  in  terms 
of  system  performance,  between  navigation 
systems . 

2.  If  there  are  significant  differences,  in  terms 
of  system  performance,  between  the  selected 
levels  of  the  control  criterion. 

3.  If  there  are  significant  interaction  effects 
between  the  navigation  systems  and  the 
control  criterion. 

This  analysis  will  be  performed  using  the  SPSS  ANOVA  package. 
The  significance  level  for  the  test  is  set  at  0.05,  i.e., 
a = 0.05. 
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ANOVA  is  discussed  fully  in  reference  material 


(10,11,12) . 
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The  results  of  the  ANOVA  analysis  will  be  considered 
qualitatively  and  the  "best"  navigation  system  will  be  chosen. 

In  making  a selection,  intangible  elements  need  to  be  con- 
sidered. Bear  in  mind,  this  is  solely  an  example  of  the 
use  of  the  SPSS-SAINT  interface. 

4 

After  the  navigation  system  is  selected,  a detailed 
consideration  of  the  control  criteria  will  be  made.  The 
attempt  will  be  to  select  the  most  effective  criterion 
level,  in  terms  of  mission  performance  and  operator  work- 
load, for  use  with  the  selected  navigation  system.  Five 
control  criterion  levels  (X)  are  to  be  considered:  0,  250, 

500,  750,  and  1000  feet.  The  SPSS  SCATTERGRAM  routines 
will  be  used  to  plot  the  performance  versus  control  cri- 
terion (four  replications  of  the  mission  at  each  level  of 
the  control  criterion  will  be  performed. 

From  the  scattergram,  the  "best"  level  for  the  control 
criterion  will  be  selected.  At  this  point  the  RPV/DCF  oper- 
ating system  will  be  established  and  further  analysis  will  \ 

apply  only  to  this  system  definition. 

The  next  stage  of  analysis  will  attempt  to  discern  how 
operator  performance,  as  measured  by  Y,  influences  system  j 

performance.  Four  replications  will  be  run  at  four  values 
of  Y.  The  values  selected  are  Y = 1.0,  0.8,  0.6,  and  0.4. 

The  SPSS  REGRESSION  package  will  be  used  to  assess  a 
hypothesized  linear  relationship  between  mission  perform- 
ance and  Y.  This  analysis  will  help  provide  recommendations 
for  operator  training  and  selection. 

The  last  analysis  to  be  performed  on  this  system  w.:  11 
be  to  determine  the  relationship  between  the  performance 
measure  used  (average  linear  distance  from  target)  and  the 
two  performance  variables  collected  that  were  not  used  as 
a measure  of  mission  success  (average  cross  track  and 
ground  speed  errors) . The  SPSS  PEARSON  CORR  program  will 
be  employed  here.  This  analysis  will  provide  information 
on  how  well  these  other  performance  variables  can  predict 
overall  mission  success  and  could  aid  in  identifying  appro- 
priate operating  training  techniques.  The  sixteen  replica- 
tions performed  above  will  be  used  for  this  analysis. 

The  above  procedures  will  clearly  illustrate  how  SAINT 
and  SPSS  can  be  coordinated  to  analyze  simulation  results 
and  provide  some  insights  into  RPV/DCF  system  design. 
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SECTION  V 


SAINT  MODEL  OF  THE  RPV/DCF  SYSTEM 


The  SAINT  model  of  the  RPV/DCF  system  is  depicted  in 
Figure  4.  The  following  sections  will  present  the  technical 
documentation  for  this  model.  Each  task  in  the  SAINT  net- 
work is  described  in  detail.  Then  the  definitions  of  the 
information  attributes,  resource  attributes,  user  functions, 
moderator  functions,  distribution  sets,  and  user  statistics 
used  in  the  model  are  presented.  The  state  variables  and 
monitors  used  in  the  model  are  then  described.  Lastly,  the 
definition  of  the  user-common  variables  are  presented  with 
a listing  of  each  user-written  subprogram. 

The  data  input  and  SAINT  output  for  this  model  are 
given  in  Appendices  A,  B,  and  C.  Appendix  A lists  the 

SAINT  and  user-supplied  input  to  the  model.  Appendix  B 
presents  the  SAINT  echo  check  of  the  data.  Appendix  C 
provides  examples  of  the  statistics  and  histograms  generated 
for  each  simulation  of  the  model. 


Tasks  of  the  SAINT  Network 


This  section  describes  the  tasks  of  the  SAINT  network 
which  is  presented  in  Figure  4.  Each  task  will  be  fully  de- 
fined in  terms  of  conditions  causing  its  release,  represented 
activity,  purpose,  performance  time,  attribute  assignment 
information,  and  branching  characteristics.  Before  each  task 
is  discussed  individually,  some  characteristics  common  to 
all  tasks  will  be  presented. 

1.  All  tasks  have  a priority  of  0.0  unless 
otherwise  specified. 

2.  No  special  SAINT  statistics  are  kept  for 
any  task. 

3.  Assignments  (at  all  tasks  that  have  assign- 
ments) are  made  at  the  completion  of  the 
task  unless  otherwise  specified. 

Tables  2,  3,  4,  5,  6,  and  7 at  the  end  of  this  section 
summarize  the  information  attributes,  resource  attributes, 
user  functions,  moderator  functions,  distribution  sets,  and 
statistical  codes  used  in  the  model,  respectively. 
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REQUEST  STATUS 


Figure  4(1).  SAINT  Network  Model  of  the  RPV/DCF  System. 


Task  1.  Await  the  Launch  of  the  First  RPV 
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This  task  is  released  at  the  start  of  the  simulation 
and  initiates  the  activities  of  the  operator,  resource  1, 
the  only  resource  involved  in  the  simulation. 

This  activity  represents  the  operator's  waiting  for 
the  launch  of  the  tirst  RPV. 

The  task  performance  time  is  10  seconds. 

Information  attribute  1 is  set  to  0 to  initiate  this 
operator's  scanning  of  the  RPVs.  Resource  attributes  1 and 
2 of  the  operator  are  set  to  the  control  criterion  level 
and  patching  probability,  respectively,  for  the  current 
iteration. 

This  task  causes  the  operator  to  proceed  to  task  2 
where  he  starts  requesting  the  status  information  for  the 
RPVs. 


Task  2.  Request  the  Status  of  the  Next  RPV 

This  task  is  released:  1)  from  task  1 at  the  start 
of  the  simulation;  2)  from  task  4 whenever  the  operator 
determines  that  the  lateral  deviation  of  an  RPV  is  not 
large  enough  for  him  to  patch;  3)  from  task  5 whenever  the 
operator  decides  he  will  not  patch  an  RPV  even  though  its 
lateral  deviation  is  large  enough  for  a patch  to  be  made; 

4)  from  task  8 whenever  there  is  a turn  on  the  screen  that 
prevents  the  operator  from  patching  an  RPV;  or  5)  from 
task  9 after  the  operator  has  input  a patch  to  an  RPV. 

This  task  represents  the  operator's  activities  as  he 
light  pens  "STATUS"  and  light  pens  the  RPV  so  that  he  can 
determine  the  lateral  deviation  of  this  RPV.  The  number 
of  the  RPV  that  he  will  consider  will  be  one  greater  than 
the  RPV  he  has  just  considered,  or  it  will  be  1 if  the 
last  RPV  that  he  considered  was  the  last  RPV  of  the  mission. 

The  task  performance  time  is  defined  by  distribution 
set  number  1. 

Information  attribute  1 is  assigned  a value  through  a 
t call  to  user  function  1.  Information  attribute  1 is  set  to 

! the  number  of  the  RPV  that  is  to  be  considered  at  this  time. 

, Upon  completion  of  this  task,  the  operator  proceeds 

to  task  3 to  wait  for  the  requested  status  display. 
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Task  3.  Wait  for  Status  Display 

This  task  is  released  whenever  the  operator  has  re- 
quested a status  display  for  an  RPV  at  task  2. 

This  task  represents  the  operator's  activities  as  he 
waits  until  the  status  display  is  presented. 

The  task  performance  time  is  computed  in  moderator 
function  1 as  the  time  to  the  next  5 second  interval. 

No  attribute  assignments  are  made  at  this  task. 

This  task  causes  the  operator  to  proceed  to  task  4, 
where  he  decides  whether  or  not  to  patch  this  RPV  based  on 
the  status  information. 


Task  4.  Determine  If  a Patch  Is  Required 

This  task  is  released  from  task  3 whenever  the  status 
display  for  an  RPV  has  been  requested  and  received  by  the 
operator. 

This  task  represents  the  operator's  activities  as  he 
decides  whether  or  not  the  lateral  deviation  of  the  RPV  is 
large  enough  to  cause  him  to  patch.  The  operator  will  de- 
termine that  the  lateral  deviation  value  is  large  enough  to 
cause  him  to  patch  whenever  it  is  greater  than  the  value  of 
his  resource  attribute  1,  defined  as  that  value  above  which 
he  is  required  to  patch  an  RPV. 

The  task  performance  time  is  defined  by  distribution 
set  number  2. 

Information  attribute  2 is  assigned  the  value  in  user 
function  2 to  reflect  the  operator's  decision  at  this  task. 
Information  attribute  2 is  set  to  1 if  the  lateral  deviation 
value  of  his  RPV  is  large  enough  to  cause  this  operator  to 
patch.  It  is  oat  to  0 otherwise. 

The  operator  proceeds  from  this  task  based  on  his  deci- 
sion as  defined  in  information  attribute  2.  If  he  is  re- 
quired to  patch  this  RPV,  he  will  proceed  to  task  5 which 
determines  whether  or  not  he  actually  will  patch  the  RPV. 
Otherwise,  he  will  return  to  task.  2 to  consider  status 
checks  on  other  RPVs . 


Task  5.  Determine  If  the  Operator  Will  Patch 

This  task  is  released  from  task  4 whenever  the  operator 
discovers  that  he  is  required  to  patch  an  RPV  at  this  time. 
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This  task  represents  the  operator's  activities  as  he 
determines  whether  or  not  he  will  patch  the  RPV.  The  oper- 
ator occasionally  will  not  patch  an  RPV  when  it  is  required. 
He  will  only  patch  an  RPV  at  this  point  Y%  of  the  time, 
where  Y is  defined  in  resource  attribute  2. 

The  task  performance  time  is  0. 

Information  attribute  2 is  assigned  a value  in  user 
function  3 that  reflects  the  operator's  patching  operations. 
If  he  will  patch  the  RPV,  information  attribute  2 is  set  to 
1.  Otherwise,  information  attribute  2 is  set  to  0. 

The  operator  proceeds  from  this  task  based  on  the  deci- 
sion process  as  defined  above.  If  he  will  patch  the  RPV, 
he  proceeds  to  task  6 to  start  the  patch  operation.  Other- 
wise, he  returns  to  task  2 to  consider  status  checks  on 
other  RPVs . 


Task  6.  Request  the  Patch  Display 

This  task  is  released  whenever  the  operator,  at  task  5, 
decides  to  perform  a patch  on  an  RPV. 

This  task  represents  the  operator's  ictivities  as  he 
light  pens  "PATCH"  and  light  pens  the  RPV.  By  performing 
these  functions,  the  operator  is  requesting  the  patch  dis- 
play so  he  can  patch  the  RPV. 

The  task  performance  time  is  defined  in  distribution 
set  3 . 


No  attribute  assignments  are  made  at  this  task. 

The  operator  proceeds  from  this  task  to  task  7,  where 
he  waits  for  the  patch  display  to  be  presented. 


Task  7.  Wait  for  the  Patch  Display 

This  task  is  released  from  task  6 whenever  the  operator 
has  requested  a patch  display. 

This  task  represents  the  operator's  activities  as  he 
waits  for  the  display  to  be  presented. 

The  task  performance  time  is  computed  in  moderator  func- 
tion 2,  which  computes  the  time  to  the  next  five  second 
interval  after  the  release  of  this  task. 

No  attribute  assignments  are  made  at  this  task. 


26 


r 


After  waiting  for  and  receiving  the  patch  display,  the 
operator  proceeds  to  task  8 where  he  determines  whether  or 
not  there  is  a turn  on  the  console  screen  that  will  prevent 
him  from  patching  this  RPV. 

ll 

' : 

, Task  8.  Determine  If  a Turn  Prevents  Patching 

i This  task  is  released  from  task  7 after  the  operator  has 

requested  and  received  the  patch  display. 

This  task  represents  the  operator's  activities  as  he 
determines  whether  or  not  there  is  a turn  on  the  console 
screen  that  will  prevent  him  from  patching  this  RPV.  A 
patch  will  be  prevented  whenever  the  next  flight  path  turn 
of  the  RPV  is  less  than  five  nautical  miles  from  the  RPVs 
current  VFPPE.  The  operator  is  automatically  informed  of 
this  condition.  Consequently,  the  task  performance  time  is 
0. 

Information  attribute  2 is  assigned  a value  in  user 
function  4 that  reflects  the  turn  conditions  of  this  RPV. 

If  there  is  a turn  on  the  screen  that  prevents  the  operator 
from  patching  this  RPV,  information  attribute  2 is  set  to  0. 
If  not,  information  attribute  2 is  set  to  1. 


The  operator  proceeds  from  this  task  based  on  the  turn 
conditions  discussed  above.  If  a turn  prevents  him  from 
patching  this  RPV,  he  returns  to  task  2 to  consider  status 
checks  on  other  RPVs.  If  no  turn  prevents  his  patching, 
he  proceeds  to  task  9 to  input  the  patch  for  this  RPV. 


Task  9.  Input  the  Patch  Points 

This  task  is  released  from  task  8 whenever  the  operator 
has  determined  that  a patch  is  to  be  made  on  an  RPV.  He 
arrives  at  this  node  with  the  console  screen  prepared  to 
accept  patch  points. 
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This  task  represents  the  operator's  activities  as  he 
inputs  the  patch  point  through  the  console  screen.  The 
operator  will  input  one  patch  point  along  the  flight  path 
of  the  RPV.  The  point  is  set  3.0  nautical  miles  ahead  of 
the  VFPPE  position  of  the  RPV. 

The  task  performance  time  is  defined  by  distribution 
set  4 . 

User  function  5 is  called  at  the  start  of  this  task, 
to  assign  values  to  information  attributes  3 and  4.  These 
information  attributes  will  be  assigned  values  that  repre- 
sent the  x-position  of  the  patch  point  and  the  y-position 
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of  the  patch  point,  respectively. 

After  inputting  the  patch  point,  the  operator  proceeds 
to  task  2 where  he  continues  to  consider  status  checks  on 
other  RPVs . The  command  input  by  the  operator,  as  repre- 
sented by  the  information  attribute  packet,  proceeds  to 
task  10  for  processing. 


Task  10.  Delay  the  Patch  Command  Before  Transmission 

This  task  is  released  from  task  10  after  the  operator 
inputs  a patch  for  an  RPV. 

The  purpose  of  this  task  is  to  represent  a processing 
delay  between  the  command  input  and  the  command  transmission. 

No  resources  are  required  for  the  performance  of  this 

task . 

The  task  performance  time  is  computed  in  moderator 
function  3,  which  computes  the  time  to  the  second  frame  up- 
date following  the  release  of  this  task.  This  time  repre- 
sents the  delay  indicated  above. 

No  attribute  assignments  are  made  at  this  task. 

The  information  attribute  packet  representing  the  patch 
command  proceeds  to  task  11  for  processing. 


Task  11.  Process  the  Patch  Command 

This  task  is  released  from  task  10  whenever  a command 
is  to  be  processed. 

The  purpose  of  this  task  is  to  process  the  patch  com- 
mand input  by  the  operator.  The  commands  input  by  the 
operator  are  processed  at  this  task  through  a call  to 
moderator  function  4,  which  updates  all  the  pertinent  state 
variables  to  reflect  the  command.  This  updating  includes 
the  definition  of  a revised  flight  path  segment  for  the 
RPV  between  its  current  position  and  the  patch  point  re- 
quested. The  RPV  will  follow  this  revised  flight  path  from 
the  time  the  patch  takes  effect  until  the  RPV  reaches  the 
patch  point. 

No  resources  are  required  for  the  performance  of  this 

task. 

The  task  performance  time  is  0. 
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No  attribute  assignments  are  performed  at  this  task. 

No  branching  occurs  from  this  task. 

The  task  priority  is  set  to  1.0  to  insure  that  com- 
mand processing  is  performed  before  information  is  updated 
at  task  12. 


Task  12.  Process  the  Frame  Update 


This  task  is  released  at  the  beginning  of  the  simulation 
and  every  five  seconds  thereafter. 

This  task  processes  the  frame  update  information. 

This  information  is  processed  through  a call  to  moderator 
function  5,  which  updates  all  the  pertinent  program  vari- 
ables . 

No  resources  are  required  for  the  performance  of  this 

task . 


The  task  performance  time  is  5 seconds. 

No  attribute  assignments  are  made  at  this  task. 

This  task  branches  back  to  itself  for  the  processing 
of  the  next  frame  update. 

The  task  priority  is  set  to  0.5  to  insure  that  the  up- 
date is  processed  before  the  operator  accesses  it  and  to 
insure  that  existing  command  processing  is  reflected  in  the 
updated  information. 


Task  13.  Process  an  FPPE  Turn 

This  task  is  signaled  through  a monitor  whenever  it  is 
time  for  an  RPV  to  alter  its  course  according  to  its  revised 
flight  path.  (If  no  revised  flight  path  segments  are  cur- 
rently in  effect,  the  revised  flight  path  is  the  same  as 
the  original  flight  path.) 

The  purpose  of  this  task  is  to  cause  the  FPPE  and  the 
true  position  of  the  RPV  to  turn  towards  the  next  flight 
path  point.  This  is  accomplished  through  a call  to  modera- 
tor function  6,  which  updates  all  the  pertinent  program 
variables . 

No  resources  are  required  for  the  performance  of  this 

task. 
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The  task  performance  time  is  0. 

No  attribute  assignments  are  made  at  this  task. 
No  branching  occurs  from  this  task. 


Task  14.  Process  a VFPPE  Turn 

This  task  is  signaled  through  a monitor  whenever  it  is 
time  for  an  RPV  to  alter  its  course  according  to  its  orig- 
inal flight  path. 

The  purpose  of  this  task  is  to  cause  the  VFPPE  posi- 
tion of  an  RPV  to  change  its  heading  and  move  towards  the 
next  flight  path  point.  This  is  accomplished  through  a 
call  to  moderator  function  7,  which  updates  all  the 
pertinent  program  variables.  The  RPV  is  not  turned  at 
this  task  as  it  may  be  following  a revised  flight  path 
segment.  However,  if  a revised  flight  path  segment  is  not 
in  effect,  task  13  will  be  processed  at  the  same  time  as 
this  task. 

No  resources  are  required  for  the  performance  of  this 

task . 

The  task  performance  time  is  0. 

No  attribute  assignments  are  made  at  this  task. 

No  branching  occurs  from  this  task. 


Task  15.  End  the  Simulation 

This  task  is  signaled  through  a monitor  whenever  all 
the  RPVs  have  achieved  their  targets. 

The  purpose  of  this  task  is  to  cause  the  end  of  the 
simulation. 

No  resources  are  required  for  the  performance  of  this 

task. 

The  task  performance  time  is  0. 

No  attribute  assignments  are  made  at  this  task. 

This  task  is  a sink  task  and  branches  to  end  the  simu- 
lation. 
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State  Variables  and  Monitors 


State  variables  for  the  SAINT  model  of  the  RPV/DCF 
system  represent  flight  parameters.  SS(1)-SS(5)  represent 
the  time  of  the  next  turn  for  the  FPPE  of  RPVs  1-5,  respec- 
tively. SS(6)-SS(10)  are  set  to  the  time  of  the  next 
VFPPE  turn  for  RPVs  1-5.  SS  (11) -SS (15) , SS ( 16-SS (20) , 

SS  (21)-SS (25)  , SS (26)-SS (30) , SS ( 31) -SS ( 35) , andSS(36)- 
SS(40)  are,  respectively,  the  true  x-coordinates , the  true 
y-coordinates , the  FPPE  x-coordinates,  the  FPPE  y-coordinates , 
the  VFPPE  x-coordinates,  and  the  VFPPE  y-coordinates  of  the 
RPVs.  SS(41)  represents  the  current  time  and  SS(42)  is  a 
flag  used  for  halting  the  simulation  when  all  RPVs  have 
achieved  the  target.  These  state  variables  are  defined 
more  fully  in  Table  8. 

Monitors  1-5  detect  the  next  turn  for  the  FPPEs  of 
RPVs  1-5,  respectively.  Monitors  6-10  detect  the  turns  for 
the  VFPPEs  of  RPVs  1-5,  respectively.  Monitor  11  detects 
SS(42)  crossing  1.0  to  end  the  simulation.  The  monitors 
are  presented  in  Table  9. 
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TABLE  2 


INFORMATION  ATTRIBUTE  DEFINITIONS 


Information  Definition 

Attribute  

1 Number  of  RPV  being  considered. 


2 

3 

4 


Decision  Value:  See  Table  4 for 
definition  at  each  task. 

X-coordinate  of  patch  point  of  an 
operator's  patch. 

Y-coordinate  of  patch  point  of  an 
operator's  patch. 
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TABLE  3 

RESOURCE  ATTRIBUTE  DEFINITIONS 


Resource  Definition 

Attribute 


1 Lateral  deviation  value  of  an  RPV 

above  which  operator  is  required  to 
patch  the  RPV  (control  criterion) . 

2 Probability  that  operator  will 

patch  an  RPV  when  he  notices  that 
its  lateral  deviation  is  greater 
than  resource  attribute  1. 
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TABLE  4 


User 

Function 

1 


2 


3 


4 


5 


DESCRIPTION  OF  USER  FUNCTIONS 


Function  of  Task  Calling  This 

User  Function  User  Function 

Determine  number  of  next  2 

RPV  to  be  considered  for 
a status  check.  Set  in- 
formation attribute  2 to 
the  number  of  this  RPV. 

Determine  if  the  lateral  4 

deviation  of  this  RPV  is 
high  enough  to  cause  the 
operator  patch.  Set  in- 
formation attribute  2 to 
1 if  it  is;  to  0 other- 
wise. 

Determine  if  the  operator  5 

will  patch  this  RPV.  Set 
information  attribute  2 to 
1 if  he  will;  to  0 other- 
wise. 

Determine  if  a turn  pre-  8 

vents  patching.  Set  in- 
formation attribute  2 to 
0 if  it  does,  to  1 other- 
wise . 

Set  information  attributes  9 

3 and  4 , the  x-  and  y- 
coordinates  of  the  patch 
point,  respectively. 


TABLE  5 


DESCRIPTION  OF  MODERATOR  FUNCTIONS 


Moderator  Function  of  Task  Calling  This 

Function  Moderator  Function  Moderator  Function 

1 Compute  the  time  until  3 

the  status  information  is 

displayed. 

2 Compute  the  time  until  the  7 

console  is  prepared  to 

accept  patch  points. 

3 Compute  the  time  until  10 

this  patch  command  is  sent 

to  the  RPV . 


4 

Process 

patch  command. 

11 

5 

Process 

frame  update. 

12 

6 

Process 

FPPE  turn. 

13 

7 

Process 

VFPPE  turn. 

14 
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TABLE  7 


STATISTICAL  CODES 


Statistic  Statistic 


Code 

Variable  Recorded 

UCLCT 

1 

Linear  deviation  from  the  target  at 
the  time  the  trigger  is  pulled  for 

UKIST 

1 

an  RPV,  observed  for  each  RPV. 

UCLCT 

2 

Ground  course  error  for  an  RPV, 
observed  every  five  seconds  for 

each 

UHIST 

2 

RPV  in  flight  to  the  target. 

UCLCT 

3 

Ground  speed  error  for  an  RPV, 
observed  every  five  seconds  for 

each 

UHIST 

3 

RPV  in  flight  to  the  target. 
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MONITOR  INFORMATION 


User-Written  Subprograms 


There  are  five  user-written  subprograms  for  the  SAINT 
model  of  the  RPV/DCF  system.  Subroutine  INTLC  initializes 
the  user  COMMON  and  state  variables  of  the  model  and  inputs 
flight  path  information.  Subroutine  STATE  computes  the 
flight  path  positions  as  the  simulation  progresses.  Sub- 
routine MODRF  and  USERF  process  the  moderator  and  user 
functions  of  the  model.  Subroutine  ENDIT  collects  the 
outputs  for  each  iteration  and  prepares  for  the  next  iter- 
ation. 

Table  10  defines  the  user  COMMON  and  state  variable 
equivalenced  mnemonic  variables  of  the  model.  Figures  5 
through  8 present  the  FORTRAN  listings  of  subroutines 
INTLC,  STATE,  MODRF  and  USERF.  Subroutine  ENDIT,  which 
is  altered  for  each  phase  of  the  SPSS  analysis,  will  be 
presented  in  the  next  section. 
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USER  COMMON  AND  STATE  VARIABLE  EQUIVALENCED  MNEMONIC  VARIABLES 
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THIS  PAGE  IS  BEST  QUALITY PRACTICAJajI 
FROM  COrY  EUMilbiuiD  TO  DD.C  


SUBROUT  I ME  I NT  LC 
C 

DIMENSION  FPPcX  (s'  I ,FPs-r  I;  > ,TRUEX  ( 5 ) , TRUEY  ( r > , 7=  P PX  ( •>  » , VFps  Y ( ;» 
DIMENSION  T/FPEtal  .TFP»-:<t) 

COMMON  /UCOM1/  COhVF.CONVV.PI 
COhMCN  / UC  0 M 2 / CSPE0,3*EE0(5> 

COMMON  /UCOU/  FXH£0(3l  , FYH£0(  = 1 ,TXH£j  (5)  , TYriEOu  ) , VXHEOI'  ) , VYHEC  ( 

*5) 

COMMON  /UCO  M-,/  IFLX  (s  I , 4FPP£  (i)  ,NVF0P  (>  I 
COMMON  /UCO, 15 / XFPP£(",2  J)  , YFPPEIE  , 23) 

COMMON  / JCOiB/  XlATO(;i ,X/FPF(20) ,YYF=P(2C) 

COMMON  /CUMOb/  TWOH,  TTME  X .MFAJ.SEtO  ,IS EEC  .NCROP a N°R NT , IIPUNC H , 

* f.KUI  T , NRc N T , MN OC  a N DC  a (L‘  T N , NN 7C 

COMMON  /CCM16/  4 A£RRt  DTM4  X , 31  MIN , CT 34  V . IITES , L LERR , RRERR,  TT L,* 3 a 

* T T34  V , OTSJG , DT  FUL  , C T.N3  4 . 13 E&  S.  RES wS  a C7  ACC , Ll  34  V, 

* LSAVE 

COMMON  /CO;  11 7/  S3  <10C  ) , 3SL(  ICO)  ,3C<  ICO)  ,00L  (ICC)  »t__S7=<103.2) 
COMMON  /CCMia/  IS ( 2 J ) » 1 4343 ( 3„  3 ) ,Y13m»  (oJ  0 > 

COMMON  /CCM22/  TTIME.FFIRJ 

EQUIVALENCE  CS3(,1>  t CTI'IE ) a (33(02)  .EfiOSH) 

EQUIVALENCE (33 (21) ,F?°£X ( l) ) , (S3 ( 26) . f°P£Y ( 1 ) ) 

EQUIVALENCE  (33  (1 ) ,TFPP£( t I ) , ( 33  <o ) , T VFPE ( 1 ) ) 

EQUIVALENCE (SS (lilt  TRUcX ( 1 ) ) , <SS ( lb) 9 TRUE* ( 1) ) 

EQUIVALENCE  (S3  ( 31 ) 9 VFppx(I)  I , ( SS  ( 3o  ) t Vca  P Y ( 1 ) i 


INITIALIZE  VaRI43^E3* 

CONVFscOiC. 
C0NVV=cGi£*/3oCut 
00  10b  1*1,5 
TFPPE  (II  *'»99-j9. 

TVFPE(I)  = <39959. 
TRUEX(I)=1J,*C3nVF 
TRUEY(II*10.*CONVF 
FPP£X(I) *10.*CCNVF 
FPPEy(II*15.»CCNVF 
vFppxo  sia.  * wCN  VF 
VFFPY(I)*10.»ClNVF 
XLATOII ) *C  . 

SPt EO ( 1 1 = 0. 

FXMEO(I)*C. 

FYHcC(II*0. 

TXmEC(I»*0. 

TYMEO(I)=0. 

VXmcO ( I ) * c • 

VYhEO ( I ) * 0 • 

ifly ( : i *o 

100  CONTINUE 
PI*  3. 1-,1S<9 
CTIME*C. 

CSP£C*nJ3.*C0nw 
EN03M* 0 a 
00  20  C 1*1,3 
00  15  0 J*  1 , 2 3 
XFPPE (I , J )*3. 

YFPPt ( I 9 J ) * 3 9 
ISO  CONTI, aUE 
NFrPc ( I ) * w 


Figure  5(1).  FORTRAN  Listing  of  Subroutine  INTLC. 
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nvfpf  c 1 1 * c 

200  COnTInUl 

00  10C  J*l,2i 
XVFPP<JI=C. 
YVFPP( J)*0. 
300  CONTINUE 


IMS  PAGB  IS  BBST  QUALITY FRWJHCABH 

FROM  COPY  FURNISHED  TO  DDC  


INPUT  Plight  path  ICJROINATES  Fj-;  i/fppe. 

REACUCROR.IO)  IPT 

REAOlr.CROK,  2C  ) TXVFPP(J)  «J*1»IPT> 

REAO<NCROR,20>  (YVFPPU) . J=1.I?T> 

00  400  J*  1 i IPT 
XVFPP ( J) * XVFPP ( J| *C0NYF 
YVFPP  U) sYYFPPI J)»CGNVP 
400  CONTINUE 


DEFINE  FPF  c flight  path  coordinates. 


DO  500  1=1.5 
NFPPE (II SIPT 
NYFPP ( I ) = ip  t 
00  45  0 J=  1 . 20 
XFPPt  (I . J)  = < VFPP ( J ) 

YFPPEII.J)=YVF°PI J> 

450  CONTINUE 
500  CONTINUE 

set  The  takeoff  tih.s  of  the  t*o3. 

OO  600  1=1.7 
XI=I-1 

TFPPE<il=;.*i.*XI 
TVFFEtI)=TFPP£(I) 

600  CONTINUE 

c 

10  FORPA  T (15  1 
20  FCRPAM20F-..0I 
C 

RETURN 

END 


' 

• 

I 

1 

Figure  5(2).  FORTRAN  Listing  of  Subroutine  INTLC . 
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IBIS  PAGE  IS  BEST  QUALITY  PRACTICABU 

YHM  COPY  FURBISHED  10  DUG ^ 


c 


c 


SUoStJl  I <c  3T-7c. 


DIMENSION  FPREX  (;  ) ,/PPE  i (_, ) ,T.-!U£X  (p)  , i -CUEY  ( J ) , V'°  = x ( ) , ;Fcc  y ( ;) 
DIMENSION  TVFPEd)  ,TFs»E  <p) 

COMMON  /UC0  11/  COf.VF.COWV.PI 
COMMON  /UCC  M2/  CSPE0,S3E:.J(5) 

COMMON  /JCo.13/  FxmEJ(j)  , f YhEl  (p  I , TXhEO  (r  1 , T Y -liD  (p  ) , Vxm£;  ( .; ) , vynEu  ) 

•51 


commoi.  /ueow 
COMMON  /U  Culp/ 
COMMON  /UCOMo/ 
COMMON  /CCM06/ 

COMMON  /COM lo/ 


COMMON  / C 0 M 1 7 / 
COMMON  /CCM13/ 
COMMON  /CCM22/ 


IFLYIj>,-lFP3£<r)  ,NVPPP(r) 

XFMPi(5,2;),YFSO£(i,23) 

XtAT  0(5)  , * VFPP  (20)  ,YVF  PP  120) 

7N0W  ,TT  -iEX  ,HFA3,SEtD,ISEED  ,NCf.OR,NPRNT,NPU:.CH, 
NRNIT  . -KENT  • NMOC  .NDC  , NOTN.NNTO 

AAERR.OTlAX,  OT  MIN,  OT  3A  V , IITtStLLeR-'. » PR  ERF  . TT  LA  S , 
TTSAV. 3T3US, OTFUL , DTNOM , ISEE 3 , F ESLS , OTACC , LL  3A  V , 
LSA  VE 

S3  (1  00)  ,330  < ICG)  ,0C>(  100)  , DDL  (100)  ,,LSY=  ( 10  0,  2) 

13(20), NA3AO(3SO) ,YA3AK (030 

niME.PFIr.S 


EOUIVALENCEISSUl)  ,CTIME)  , ( S S (-2)  .ENOS'!) 
EQUIVALENCE (S3(21) ,FPP£X( 1) 1 , (3S(Zo> ,FPPEY( 1) ) 
EQUIVALENCE (S3 (1 ) ,TFPFE(1 ) ) , (3S (6 ) ,7  VFPE ( 1) ) 
EQUIVALENCE (SS (11) , TAUEx ( 1 ) ) , ( SS ( 1 5 ) , TRUE  Y ( 1 ) ) 
EQUIVALENCES  (ID  , V FPPX  ( 1)  ) , (5S  (35)  , V f=py  ( i)  ) 


COMPUTE  P.PV  FlIjHT  POSITIONS. 


00  130  1=1,5 
ITX=I ♦ 1 3 
ITY*I*15 
IFX=I*23 
IFY=I+25 
IVX=I »33 
I VYsI ♦ 35 

SS ( IT  X) =SSL ( ITX) *3P EEC ( 1 1 • T X MEO ( I )*3TNCH 
SS (ITY ) =SSL (ITY ) *S9E£0C ) *T YMEO (I ) *0TnOW 
SS ( IF  x ) = SSL ( iFXI ♦CSPEU*FXMEO(I)*OTNOW 
SS(IFYI=SSl(IFY)  ♦CSPt,J*FYHEO(I)»OTNCH 
SS(  IVX)  =SSL  (I  VX>  ♦CSPECi*  /XHEO(I)*OTNOA 
SS(IVY ) *SSL (IVY) ♦CSPEO*VYMEO(I)*QTNCN 
100  CONTINUE 

UPDAT-  the  current  time. 

SS  (*»1  ) = 03  U1 ) ♦OTNO* 

RETURN 

END 


Figure  6.  FORTRAN  Listing  of  Subroutine  STATE. 
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THIS  PACE  is  BEST  QU 

COM  furnished 


TODJ)C 


SU6RC JT INE  MOORF  ( , M » 

C 

DIME  NSI G N FP  r£*  (i  1 ) , Tr.JcX  < 3 ) , T RUE Y ( . ) ( 3 ) , VP  Ft  Y < ;) 

DIMENSION  T /FPE  (5  ) , TP**-;  ( j ) 

COMMON  /UCO.il/  C j:.7F,CC  iJV,  =1 
COMM 0.*.  /UC0<2/  CaP 

COMMON  / U C 0 1 3 / FXMEJ  (.' ) ,fyicC  (-1  ,TXrtSC  (;  ) , T YhEDI  i ) , VXME0  (5>  , VYricO  ( 

*51 

COMMON  /UCC  1-./  IFLY  (a  ) , )FR:>  E (.  ) . )VF?=  ( 5 I 
COMMON  /UCGMi  / XFPP£<3 ,20  > , YF?»:.  tE  , 23) 

COMMON  /JCUIo/  XL~TG<rl  ,XVF?F  (23)  ,YVFPP(ZC) 

COMMON  /C0MQ6/  TnOw,TTn-;x  ,M FAD, SEED  , IS EEO ,NCRDR , NPR NT . NPUNC H , 

* NRNI T , N<£  N T , MN0C,NCC, VOTN,  W)IC 

COMMON  /COM  16/  A A£  P.R,  DT  "A  X,0T  MI  N,CTS4V  , I I TE 3 , LL ERR , RRERR,  TTL-.S. 

* TT3AVtDT5UG*OTFUL»oTNOH,IaEES«-!.ESL3,OTACC»LL$.»V, 

* LS-VE 

COMMON  /OC  Ml  7/  33(13  3 I . 33l(  10 ’3)  . OC  ( 13C  ) ,0Dl  ( IOC  I , US  V-  ( 10 Q . 21 
COMMON  /00M18/  13(23)  ,N4iAD<33u>  ,YA3AMt0C) 
common  / o c m 2 2 / ttime,pf;rj 
C 

EQUIVALENCE  (33  (wl ) . or  IM-.I  , ( 3S(m2>  » E n 0 S M ) 

ECUIV-LENCE (S3 (21 ) ,FPP£X ( 1) ) , (33(26) ,F»F£Y (1 ) 1 
EQOl VaLENCi  (S3 (1) ,TF??E(1> > , (S3 (C) ,TVFPF(1) ) 

EQUIVALENCE (33 ( 11) , TRUEX ( 1)1,(33(16), TRUE*!  1) ) 

EQUIVALENCE  (33  (31 ) , VF<>»  x ( 1 ) ) , ( a5  I 36  > , VF?p  y ( 1 ) ) 


BRANCH  TO  Tm£  APPR3PRIATE  MOCFRATu*  FJN-3TI3N  3'JOE. 

GO  TO  ( 13C, 233, 30G«-f0C«?0J, feud, 72C),i 

MO  Q£  PA  TOP  FUNCTION  1.  COMPUTE  Tm£  TIME  UNTIL  THE  STATUS 
INFORMATION  IS  OIjPlAY  E0  • 


100  ITIKE*TNOta/».*l.G 

TTIME^FLUAT  ( IT  IMc ) * 5 • -T  (0  W 
me  Turn 

MODERATOR  FUNCTION  2.  Cd'PdTE  IMF  TIME  until  the  CONSOLE 
IS  PP.EPARtO  TO  hCOE3T  PITCH  f0I4TS. 

200  ITIMt=T-(UN/5.*1.0 

TTIMl  = FLOAT  (ITIMe)*5.-T  ION 
RETURN 

HUOEPATO.M  Function  3.  CONFUTE  The  TInE  UNTIl  THE  PATCH 
COMMAND  is  sent  TO  THE  SPV. 

300  ITIM£fTNOV./5.»2.3 

TTXMt=FLOAT (IT:M£)*a.-TNOX 
RETURN 


MODERATOR  FUNCTIlN  PvOCESS  PATCH  COMMAND, 

DETERMINE  FLIGHT  p>.Th  PCInTS, 


•♦00  CALL  GE  TI A ( 1 , VAlUE ) 
I*VAUE 
IP*NVPP  p ( I) 

IP 1*IR ♦ 1 


Figure  7(1).  FORTRAN  Listing  of  Subroutine  MODRF . 
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.SHIS  PAGE  IS  BEST  QUALITY  FRACttCABjJ 

JHOM  COPY  FURNISHED  10  DOC - — 


IP2*IF»2 


0£TERMl  Ncl  PATIH  POINT. 

CALL  GcTIa (3 ,XI 
CALL  GET lAU.rl 

COMPUTE  T H£  YeH  PLIGHT  PATH. 

OOLO  = jQHT  (((VFPPX(I)-X)»»2)M(YFPFY(I)-YI**2II 
ONE N=  SOP T ( ( (TF.UEX  (I  I -XI  **2)  ♦ t (TPUEY  ( 1 1 -Y  I **211 
VFPPX  (I  I * VFPP  X (I  I ♦(3UL3-0NE  M)»\/XMEO  (II 
VFPPY(I)sVFPPY(II*(3JL0-j:i£W)»/YHtG(II 
TVFPE(II=TYFP£(I>-( JCLO-G'lEw) /CSO£0 
FPP£X (II = TR JE  X (I ) 

FPPEY (I IsTRUEY (i) 

XFPPE ( I , IP1) =X 
YFPPE ( I , IP  1 1 s Y 
XFFPE ( I ■ IP2) = T K U c X ( 1 I 
YFPPt (I  ,IP2 I =TAUtY ( 1 1 
NFPPE ( 1 1 =IP  2 
GO  TO  o2i) 

’ OOEFATOP  FUNCTION  i.  F-.OCSSS  F*AH£  U = ;JTi  INFORMATION. 


500  1*1 

ITN0=T;i0H 

5 10  IFCFlY  (I  I . £Q.C  I GO  TO  3-,E 

IF(Yxm£Q(I) .£0.3.1  GO  TO  G2C 
IFUlHtOdl  .£0.0.1  GO  TO  ?30 

compute  flight  path  oeyiatilns. 

X*  (TRUEY  (II  ♦ ( YXMtC  ( I>/YYH£0  (I)  I *T  = j£X  ( I)  -VFPPY  (I  I M YYM£Q(  I)  / YXHSO  l 

♦II  I • VFPPX  (I  I )/  (YYHE01II/  JXHE0  (I)  H/XHE0  (II/VYhE0(III 
Y=(  YYhE0(  II  / / XH£  0(11  >*X»YFPPY(I>-(YYH£0(I1/YXM£3(I)>»YFPPX(I) 

XLATO ( 1 1 *SQ PT ( (TKUEX (II-XI **Z* (TRUEY ( 1 1 - Y 1 *♦?) 

SPC£  Y=  SORT  ( (YFP  PX(I I -XI **2*  (VFPPY  (I  l-Y  ) «♦?) 

GO  TC  5-0 

520  XLAT0II»*T^JeX(II-VFPPX(I) 

SPO£V  = T -<UtY  ( II -WFP®  Y Cl 

IFIXL-T 0(1) .lT.0.1  XlATO(I) =-XlATC(II 

IF  (SPOEY.LT  .0  . 1 SP0£Y*-SF0EY 

GO  TU  i - 0 

530  XLAT0(II*WF?py(II-TRJ£Y(I) 

SPGE  Y* YFP  F X ( 1 1 - TRUE  X ( 1 1 

IF  (XLATO ( 1 1 ,LT  .0  . 1 XLATO C I «-XLtT0(I) 

IF(SP0eY.LT  .3. I GPOeYs-SPOEV 

COLLECT  FLIGHT  path  deyia TIONS. 

5<*C  CALL  UCLCT(XL-T0(II  ,21 
CALL  UHIST(XlATO(II  ,21 
CALL  UClC T ( 3® jl Y , 3 I 
CALL  UH I ST ( SPUE  V , 3 1 

REPORT  FLIGHT  jTATUS  FOR  ThIS  RFY. 


COISIOt.P  (EXT  -,FY. 


Figure  7(2).  FORTRAN  Listing  of  Subroutine  MODRF . 
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550  I«I*I 

IF(I.LE.i»  lie  TO  : 1 3 
RETURN 


THIS  PACE  IS  BEST  QUALITY  PRACTICABLE 

FROM  COPY  FURNISHED  TO  DDC - 


‘lOOEFATO'v  r UNC  TIC  N y . FewCESS  ~pp.  TU*N. 


CAUSE  FP°£  T 3 HEAD  TOMASOS  T He.  NEXT  FLIGHT  PATH  POINT. 


600  IxISUl 

IFLY(I) =1 
620  IPsNFPPECl 

IF ( IF . £Q. 1)  GO  TO  6s3 
J*IP-1 

OXxXFFPEC,  JI-xFFP£  (!,;»( 

0Y*YFPP£  (I.  jl-YFFPEa.I’l 
0=SQRT(0X»»2*0Y*»2) 

FxhEC(I) *0X/0 
FYh£CC)=CY/0 
TFpPd  (I ) =T,NOW*C/Ci3iO 
NFPPE  1 1 1 rr.FPP-I  (I ) -1 
AY=ASiN(FYH£0(*l ) 

if<fxheo(d  ,lt  .o.i  ay=p:-ay 
A Y *AY  YpNO®  H < y ) 

TXhE0(II=L0S(-Y) 

TYHE0(1I*SIN(AYI 

SPtEO(I)  = CSPEO*RhOH.-|(7I»CUNYV 

return 

C**'J3£  RPV  TO  e.tO  Ful^HT.  COMPUTE  Ar  V J ; S T SI  c £ F>*G.'1 
TA.RGcT . 

650  TXhEO (I ) i c . 

TymEC ( I ) = 0 . 

FXMEOlIlsO. 

FYH£0(I)=0. 

VXhEO ( I l *C. 

VYH£0(II  = C. 

TPP»E (I)x  99999, 

TVFPtlI»=9iJi^. 

OXxTfrUEX  c>  -VFPPX (I ) 

OY  = Tr;u£Y(Il-/FpPY(I) 

OxSCRT  <0X**2»CY*»2I 
CALL  UCLCTCJ.l) 

CALL  UHI3T<0,1) 

IFLY(i)*o 
OO  660  ixl,5 
IFIIFLY(I) .EQ.l)  FETUM 
660  CONTIl U£ 

ALL  RPVS  hav£  HEACHE0  TARGET.  EnO  SIMULATION. 

ENOSMx?. 

RETURN 

l OOEFATOR  F UI.C T 1 0 < 7 • P-.OCESS  /F»F£  TURN. 

CAUSE  VFPPE  TO  HOVE  T0M,.*3S  Thc  (EXT  PLIGHT  b,TF  Pjl.T. 


700  I=IS«2I 

IPxNVFFP ( 1 1 


I 

Figure  7(3).  FORTRAN  Listing  of  Subroutine  MODRF . 

I ! 
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IHIS  PACE  IS  BEST  QUALITY  FRACTICA£U 
FROM  OOrY  F.U(RWSijj2D  10  DDC.  - 


IP< IP. EQ. II  S ETURN 
J»IF-1 

OXsXVFP?  ( J|  - x t/FPP  ( X P ) 

OYeyi/FFJfji.YyFppjjpi 

D=SCRT( CX»*2*oy**2) 
VXHEO  ( 1 1 =ox  /o 

vyheo(I)=oy/d 

TVFP£  (I  ) = Tcvjw*0/C2P£0 

M/FPFdlif.^Fspjj,.,' 

RETURN 

ENO 


;t 


Figure  7(4).  FORTRAN  Listing  of  Subroutine  MODRF . 


50 


ooo  oono  oooooooo 


THIS  PAGE  IS  BEST  QUALITY  PRACTICABLE 
FROM  COrY  FURNISHED  TO  DDC  


C 


C 


FUNCTION  USEAF(M) 


0IM£NS 
OIMENS 
COMMON 
COMMON 
COMMON 
*5  > 

COMMON 

COMMOt. 

COMMON 

COMMON 


ICn  FP^cX  (»>  , FP->cY  (•.  ) , T-.UiX  (SI  , TRUcTls)  , VCP»X  (5)  « VFPP  Y(;l 
ION  T VFPt  < 5 1 t T F®*-  ( - I 
/JCG11/  CONVF  .CJNVV  , PI 
/UC012/  CSP£0,3»Ec0(5> 

/UCO 13/  FXh£J  (il  ,FYW£U  (s)  ,TyH£„(  J|  tTYM£3(:  ) . VXH£3i(r)  , VYHiO  ( 


/UCOM-/  IFlY  (si  , NF?»t  (si  . XVFPP  (5) 

/UC0.1S/  xFPB£(st’OI  .YF  = P£(i,23l 
/ JCO  16/  XLt.T3(5l,x/FPf.(20l,YVFr?(2C) 

/CCHJ6/  TmCW,  TTnEX  , MFAO,  SEc 3 . IS EcO , NCAOA , V== NT . NPUNC H , 

* NRNIT,:(?£NT,NNOC.NCC,NCTN,NNTC 

COMMON  /C CM lo / AAcRR.Ori-X.OTMIN.CTSAV.IITES.LLERR.RRERR.TTLAS, 

* TTSAV,OTSJG.OTFUL.OTNOW,ISEt S. R£SL5 , OTACC. LlSaV. 

* LSA  Vc 

COMMON  /CCM1 7/  SS  11331, S3w(103), DC (ICu)  , OCL  ( 1 00 ),  LLSV-.  (10  9,21 
COMMON  /CCM18Z  ISI20) , V*3~3 (30JI , YA8AR (j30) 

COMMON  /CCM22/  TTIM£,PFI^j 


EQUIVALENCE  CSSUl  I .CTHSI  , (SSI *2 1 .FNOS'll 
EQUIVALENCE  (S3  (21) ,FP°it ( 1 1 I , ( SS ( 2 s I , F Y ( 1 1 I 
EQUl  V*>L£  NC  c (33  (1 1 , TF?P£(  1 I I , ( sS  (6)  ,TVF»£  ( i)  ) 
EQUlVALcNCt (Si ( 11) . T<U£X ( 1 1 I , (3S( Is) > T RUc Y ( 1)  I 
eOUI  V-lEnCc  (S3  (31)  , VF»»X(  1 1 I , (SSI  361  , VFrP  Y(  1)  I 


BRANCH  TO  The  APMO°rIATc  USER  FUNCTION  CC3E. 

GO  TO  (IOC, 200. 303. LJC, 5 331  ,» 

USc  R FUNCTION  1.  0 s T £ RMNc  THE  NUMBER  OF  IM£  NEXT  RPV 

rc  be  consioerco. 

100  CALL  GETIAI1, VALUE) 

IFIENuSM.GT.O.)  GO  TO  123 
1* VALUE 

IFCI.EQ  ,0)  GO  TO  120 

110  I*IU 

IFII.iT. 5)  GO  TO  133 
IF(IFlY(I).£0.0)  GO  TC  110 
USERFsI 
RETURN 

120  USERF  =1,0 
RETURN 
130  1*0 

GC  TO  113 

USER  FUNCTION  2.  3c  T £ RHINE  IF  THE  lATERnL  OcVIATION 
OF  THIS  RPV  IS  cAR-Ic  EnCUSH  TO  CAUSE  HE  0’£EAT0=  TO  PATCH. 

200  CALL  Gc  TIN  (1  , VALUE! 

I*value 

UStSF  = c • 

CALL  G£TRA(1,1, VALUE) 

IF(XLAT0(  I)  .5c.  VALUE)  JScSPal.3 
RETURN 


USER  FUNCTION  3.  DcTERMINZ  IF  Tm£  OPE-'.ATC-  WILL  PaTCH 
THIS  RPV. 


Figure  8(1).  FORTRAN  Listing  of  Function  USERF. 
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o o o o o o o 


THIS  PAGE  IS  BEST 

TOO*  OOPI  furnished  TO  DDC 


c 

300  call  GETRA  (1 ,2, VALUE) 
USERF=0. 

XX*3RAN3( ISEEJ) 

IF (VALUE. GT. XX)  USE-.F=l.J 
RETURN 


USER  F'JNSTIuN  ...  JETERnInE  A Tukn  PREVENTS  PATCHING. 

400  USfcRFsl.il 

CALL  SETIAU., VALUE) 

I=VALU£ 

0IST  = (TVFPfc  (I)-TnOR) *C33l  3/CCNVF 
IF(OIST.LT,3,OI  USl*F=3. 

RETURN 


USER  FUNCTION  3.  3iT  THE  C3CR0INATES  OF  The  PATCH  POINT 
IN  INFORMATION  ATTRIJUTcS. 

50C  OIST  = 3. 0 *C0  ( VF 

CALL  GETIAI1, VALUE) 

I*VALUE 

XsVFPFX(I) »JI3T*VXHE0(I) 

Y*VFPPV(I)*OIST»VYHl3<:) 
call  FUTIA ( 3 , X ) 

call  rutihu.y) 

RETURN 

ENC 


Figure  8(2).  FORTRAN  Listing  of  Function  USERF. 
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SECTION  VI 


SPSS  ANALYSIS 


As  indicated  previously,  the  effort  reported  herein  is 
designed  to  illustrate  the  interface  of  output  from  a SAINT 
simulation  with  the  SPSS  statistical  routines.  The  model 
analyzed  has  been  kept  relatively  simple  to  facilitate  the 
discussion  of  this  interface.  The  following  discussions 
emphasize  the  procedures  and  FORTRAN  coding  required  to 
achieve  the  SAINT-SPSS  interface.  They  do  not  provide 
detailed  information  on  SPSS  capabilities,  statistical  pro- 
cedures, or  SAINT  modeling.  The  interested  reader  is 
referred  to  the  references  cited  in  this  report  for  de- 
tailed discussions  on  these  topics.  In  addition,  this 
analysis  is  not  intended  to  fully  define  all  the  possible 
interface  capabilities  nor  is  it  intended  to  be  as  complete 
and  precise  an  analysis  as  one  that  would  be  done  with  a 
SAINT  model  of  a real-world  system.  Again,  the  analysis  is 
solely  intended  to  illustrate  the  methodology  required  for 
a SAINT-SPSS  interface. 


Analysis  of  Variance 

The  first  analysis  is  designed  to  determine  if  there  is 
a statistically  significant  difference  between  navigation 
systems  (A  and  B)  and  between  the  two  levels  of  the  con- 
trol criterion  (0  and  1000  feet)  in  terms  of  the  average 
linear  distance  that  the  five  RPVs  are  from  the  target  at 
the  time  they  deliver  their  payload  (hereafter  referred  to 
as  "average  linear  distance") . Four  replications  (itera- 
tions) of  each  combination  of  navigation  system/control 
criterion  were  made.  The  significance  level  for  the  test 
is  0.05.  The  ANOVA  model  for  this  analysis  is  given  below: 


Yijk  ' M + N.  + Cj  + NCij  + E(iJ)k 
1=1,2  3=1,2  k=l , 2 , 3 , 4 


where 


\i  = overall  mean 

N^  = effect  of  the  ith  navigation  system 

Cj  = effect  of  the  jth  control  criterion 


NC = effect  of  the  interaction  of  the  ith  navi- 

gation  system  with  the  jth  control  criterion 

e(ii)k  = within  error  of  the  kth  average  linear 
-1  distance  in  the  ith  navigation  system  and 

jth  control  criterion  setting 

In  order  to  perform  this  analysis,  the  parameters 
(navigation  system  and  control  criterion)  must  be  set  for 
each  iteration  of  the  model,  the  appropriate  statistics 
must  be  collected  from  each  iteration,  and  the  information 
collected  must  be  output  in  a form  consistent  with  SPSS 
input  requirements.  The  FORTRAN  code  in  subroutine  ENDIT 
performs  all  of  these  functions. 


Parameter  Definitions 


Subroutine  ENDIT  is  called  automatically  by  SAINT  at  the 
end  of  each  iteration.  It  is  called  with  one  integer  argu- 
ment, the  number  of  the  iteration  that  was  just  completed. 
Subroutine  ENDIT,  which  is  user-coded  will  process  informa- 
tion based  on  this  iteration  number. 

For  this  analysis,  the  sixteen  iterations  that  were 
performed  are  defined  below: 

Iteration 
Number 

1-4 
5-8 
9-12 
13-16 


Navigation 

System 

A 

B 

A 

B 


Control 

Criterion 

0 

0 

1000 

1000 


Initially,  SAINT  data  input  defines  the  system  as 
employing  navigation  system  A and  control  criterion  0.  At 
the  end  of  iteration  4,  ENDIT  changes  the  navigation  system 
to  B.  After  iteration  8,  it  causes  navigation  systems  A 
and  control  criterion  1000  to  be  used.  After  iteration  12, 
it  changes  the  navigation  system  back  to  B. 

In  the  model,  the  navigation  system  is  defined  by  dis- 
tribution sets  6 and  7.  Distribution  set  6 defines  the 
ground  course  error  of  the  navigation  system;  distribution 
set  7 defines  the  ground  speed  error.  The  means  of  these 
distributions  for  both  navigation  systems  are  0.  Thus, 
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ENDIT  need  only  alter  the  standard  deviations  of  these 
distributions  to  model  different  naviqation  systems. 

Since  both  distributions  are  normal,  SAINT  variables 
PARAM (6,4)  and  PARAM(7,4)  define  the  standard  deviations  of 
distribution  sets  6 and  7,  respectively.  Therefore,  when 
required  to  change  a navigation  system,  ENDIT  resets  the 
values  of  PARAM(6,4)  and  PARAM(7,4).  These  variables  remain 
at  the  assigned  values  until  ENDIT  again  changes  them. 

ENDIT  changes  the  control  criterion  used  for  each 
iteration  in  a similar  fashion.  The  control  criterion  is 
defined  in  distribution  set  8.  Since  this  distribution  is 
constant,  SAINT  variable  PARAM (8,1)  represents  the  control 
criterion.  It  is  reset  when  required  by  ENDIT. 

The  values  assigned  to  the  above  mentioned  variables 
are  summarized  below: 


Iteration 

Number 

PARAM (6,4) 

PARAM (7, 4) 

PARAM (8 

1-4 

0.035 

10.0 

0.0 

5-8 

0.005 

2.0 

0.0 

9-12 

0.035 

10.0 

1000.0 

13-16 

0.005 

2.0 

1000.0 

SPSS  Format 

Subroutine  ENDIT  will  produce  a file  of  output  (file 
NOTPT)  that  will  serve  as  input  to  the  SPSS  statistical  rou- 
tines. Input  to  SPSS  generally  follows  the  form: 

SPSS  CONTROL  CARDS 
SPSS  PROCEDURE  CARDS 
DATA  INPUT 
FINISH  CARD 

Subroutine  ENDIT  must  produce  output  in  this  format.  For 
this  reason,  when  ENDIT  is  called  after  the  first  iteration, 
it  produces  the  SPSS  control  and  procedure  card  file  prior 
to  processing  data.  Additionally,  ENDIT  processes  the 
FINISH  card  after  processing  the  data  for  the  last  itera- 
tion. The  SPSS  control  cards  will  not  be  discussed  in  this 
report.  They  are  fully  described  in  reference  material  [1]. 
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Data  Input 


After  each  iteration,  ENDIT  outputs  to  file  NOTPT  the 
data  necessary  for  the  SPSS  analysis.  For  each  iteration, 
one  card  is  prepared  which  contains  the  following  informa- 
tion: 


Data  Card  Columns 
1-10 
11-15 

16-20 


Value 

Average  linear  deviation 

Navigation  system  code 

1 = A 

2 = B 

Control  Criterion  code 
1=0  feet 
2 = 1000  feet 


Subroutine  ENDIT  determines  the  appropriate  values  for  the 
iteration  and  then  outputs  them  in  the  above  format.  The 
navigation  system  and  control  criterion  codes  are  determined 
directly  from  the  iteration  number.  However,  the  linear 
deviation  requires  some  calculation. 


For  each  iteration,  the  deviation  of  each  RPV  from  the 
target  at  the  time  it  delivers  its  payload  is  collected  in 
user-statistic  1,  using  calls  to  subroutine  UCLCT.  When 
ENDIT  is  called,  the  SAINT  variables  for  user-statistic  1 
contains  the  following  values: 


Variable  Value 

USOBV (1,1)  The  sum  of  the  deviation  of  the 
five  RPVs 


USOBV (1,2)  The  sum  of  the  squares  of  the 
deviations  of  the  five  RPVs 


USOBV (1,3) 


The  number  of  observations 


USOBV (1,4)  The  minimum  deviation  observed 


USOBV (1,5)  The  maximum  deviation  observed 


To  compute  the  average  value,  ENDIT  divides  USOBV (1,1)  by 
USOBV (1,3) . 

The  last  function  of  subroutine  ENDIT  is  to  report  the 
user-statistics  collected  and  to  clear  the  storage  for  the 
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next  iteration.  Reporting  is  performed  through  calls  to 
subroutines  UCLCT  and  UHIST  with  second  arguments  of  zero. 
Clearing  is  performed  through  subroutine  CLEAR. 

The  FORTRAN  listing  of  subroutine  ENDIT  for  the  ANOVA 
performed  is  given  in  Figure  9. 


Results 

The  SAINT  model  was  executed  for  the  sixteen  iterations 
discussed  above.  The  output  written  to  file  NOTPT  is  pre- 
sented in  Figure  10.  This  output  is  directly  input  to  the 
SPSS  statistical  routines  for  analysis.  The  job  control 
language  for  linking  the  data  file  with  the  SPSS  routines  is 
dependent  on  the  computer  installation  used  and  is  not 
presented  here.  The  SPSS  documentation  (1)  illustrates  how 
this  is  done  for  a variety  of  computers. 

The  results  of  the  SPSS  ANOVA  analysis  are  given  in 
Figure  11.  These  results  show  that  the  navigation  system 
effect  (NAVSYS)  is  significant  at  the  .001  level,  that  the 
control  criterion  effect  (NPATCH)  is  significant  at  the  .001 
level,  and  that  the  interaction  effect  (NAVSYS  by  NPATCH) 
is  significant  at  the  .999  level.  Since  the  level  of  sig- 
nificance was  set  at  .05,  the  following  conclusions  were 
made : 

1.  There  is  a statistically  significant  differ- 
ence in  terms  of  mission  performance,  between 
navigation  systems  A and  B. 

2.  There  is  a statistically  significant  difference, 
in  terms  of  mission  performance,  between  con- 
trol criteria  0 and  1000. 

3.  There  is  no  significant  interaction  effect 
between  navigation  system  and  control  cri- 
terion. 

Since  there  is  a statistically  significant  improvement 
in  mission  performance  when  navigation  system  B is  used 
instead  of  A,  the  inertial  navigation  system  (B)  will  be 
selected  for  the  RPVs  and  will  be  used  for  the  remainder  of 
this  analysis.  The  selection  of  a control  criterion  will 
be  analyzed  further. 


Scattergram  Analysis 

From  the  ANOVA  analysis  above,  there  is  a statistically 
significant  difference,  in  terms  of  mission  performance, 
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THIS  PAGE  IS  BEST  QUALITY  PRACTICAlS* 
JBOJi  OOPY  ElttrftlSHED  TO  DDC ' 


i 

: 


c 

c 

c 


SU6RCUT INE  £NJIT  (ITs.'.l 

COMMON  /CCM3  5/  PAF.A.)  (100  , •»>  ,NPTBU  (10 3 > ,PARM  1(  11 3)  , P A K.-,»  ( 1 00  ( 
COMMON  /CCM23/  lLUGC<23,2),USJ3V(20,.»)  , -LUST ( 2 C , 2) , TTIL R t 20 ) t 

* USTP  0 ( 20  t 3 > t LL'JCH  ( 23 1 2 ) . i.NCE  L ( 20  ) , HHLOW  ( 23  ( , 

• hhwI3(20)  , JJCtKvtO) 

NOTPT  SPECIFIES  THE  CARO  PUNCH  NUMBER 


C 

C 

C 


L 

C 

c 

c 


L 

c 

c 

c 

c 


c 

c 

c 

c 

c 


c 

c 


NOTPT  *7 

IF ( IT  tR • GT • 1 ) Go  TO  v00 

WRITE  SPSS  CONTROL  CAROS. 

WRITE  (NOTPT, ICO) 

WRITE (NOTPT, 101) 

WRITE (NOTPT ,132) 

WRITE (NOTPT, 103) 

WRITE (NOTPT, 13D 
WRITE (NOTPT  ,13? ) 

WRITEUtOTPT  ,10t) 

100  FORMAT (inPUN  NAME  , 7 X , 20-tS  AI  NT -SPSS  EXAMPLE  1) 

101  FORMAT  ( 1 3 HV AMIABLE  Li  3 T , 2 X , 20  HTAR  GE  T NAVSY3  -.PATC-il 

102  FORMAT (12HINPUT  ME3  I'JH , 5 X , 1 hCmRO  I 

103  FORMAT  (lOh.N  OP  CASES, JX,2Hlc) 

104  FORMAT  (12HINPUT  FORMAT , 3X , 2 3hFIX£0  (r  1 3.  3 ,F".  0 ,F;  . 3 ) ) 

105  FORMAT  (5HAN0VA.10X,  JahTARGET  3Y  N- VSYs ( 1 , 2 > , Sh(1,2>/) 

106  FORMAT  (IOhrEAO  INPUT) 

107  FORMAT (6HFINISM) 

-ETERMIN-.  NA 01  3m T 13  ( SYSTEM  TYPE  AN 3 S^.TRj,.  STRATEGY 
USED  F3R  THE  LAjT  ITERATION. 


500  GO  TO  (l,l,l,l,2,2,2,2,3,3,3,3,**,-,M,'.),IT'nt 

1 NAVS* 1 
NPAT  * 1 
GO  TO  6 

2 NAVS=2 
NPAT* 1 
GO  TG  5 

3 NAVS*1 
NPAT*  2 
GO  TO  5 

4 NA VS*  2 
NPAT*  2 


COlPUTz  THE  AVER-3E  LINEAR  UST~uCi  F:  Si  T *E  TARGET  PCR 
This  iteration  a.-.o  print  out  the  spss  oata  cars  fo*  this 

ITERATION, 

6 A VG*US03V  (1 ,1 ) /U303VI1,  3) 

WRITE  (NOTPT, 135)  aVJ.NAVS.NFAT 
10S  FORMAT ( F 1 0 . 3,Iv,I: ) 

lmUSE  SAInT  TO  m33RT  ON  PL.  JSER  COU-.IT..J  STATISTICS 
FOR  This  ITERATION.  SLEAR  THESE  STATISTICAL  storage 
ARR«ys  FOk  The  NEXT  ITi*,.TIOF. 

CALL  UC.CT ( 1.  ,0) 

CALL  UhIST(1.,G) 

CALL  CLcAP 

SET  THE  PARAMETER  VALUES  THAT  AS i A«.:.-3,.-:  F(J  = TmE 
NEXT  ITcrATILN.  PRINT  . UT  THE  SPSS  xFIMS-t*  CAPO  IP 


Figure  9(1).  FORTRAN  Listing  of  Subroutine  ENDIT 
for  the  ANOVA  Analysis. 
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c>  o 


rais  PAGE  is  BEST  QUALITY  PRACTICABLE 

OOr Y FURmish£D  TO  DDC 


THIS  WAS  THE  l-sT  ITERATION. 

GO  TO  (13*10.  lCvo.lOrlOtlJt**. 10.10.  10. 3.  lC.lj. 10.31. XT£‘: 

6 P ARAM  ( c. . - I = 3 . 0 0 3 

PARAM(7, .*1  = 2.0 
GC  Tt,  10 

7 PAkAM(o,-)=0.33E 
PARAM(7,-1=  10.  C 
PARAMI3. 11=1000. 

GO  TO  13 

8 PARAMIfc, •.1  = 0.005 
PAR  AM  (7  . » 1 = 2 • J 
GO  TO  10 

9 RRITE  (r.OTPT.1071 
10  RETURN 

ENO 


Figure  9(2).  FORTRAN  Listing  of  Subroutine  ENDIT 
for  the  ANOVA  Analysis. 
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* MB  IS  BEST  wutn 


RUN  NAME 
VARIABLE  LIST 
INPUT  MEDIUM 
N OF  CASES 
INPUT  F Cn .'AT 
A NOVA 

REAO  INPUT 
1047. BOO 
167  0.257 
1266.320 
901.906 
142.81c 
303.965 
lb7.i*39 
232.121 
1677.890 
3167.620 
1681 . 168 
2131.221 
1596.266 
o76.7o7 
1042.972 
s9  5. 3t4 
FINISH 


SaInT-SPSS  aXAMPlc  1 
TARGET  h-VGYS  'la^TCH 
CA  90 
16 

FIXED  (FlG.3,F».0,Fi  .01 

TARGET  <JY  NAVSYi(l,2l  f.P  A TCH  ( 1 , 2 ) / 

1 1 

1 1 

1 1 

1 1 

2 1 

2 1 

2 1 

2 1 

1 2 

1 2 

1 2 

1 2 

2 2 

2 2 

2 2 

2 2 


Figure  10.  Listing  of  Output  Written  to  File  NOTPT 
for  the  ANOVA  Analysis. 
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Figure  11.  Results  of  the  SPSS  ANOVA  Analysis. 


between  control  criteria  0 and  1000.  To  examine  the  control 
criterion  question  more  closely,  an  SPSS  SCATTERGRAM  analysis 
was  performed.  The  inertial  navigation  system  was  used  in 
performing  four  replications  of  five  different  control 
criteria.  The  twenty  iterations  are  defined  as  follows: 

Iteration  Number  Control  Criterion 


1-4 

0 

00 

1 

in 

250 

9-12 

500 

13-16 

750 

17-20 

1000 

In  a manner  similar  to  the  ANOVA  analysis,  subroutine  ENDIT 
defines  the  parameters  for  each  iteration,  prepares  the  SPSS 
control  cards,  and  creates  the  SPSS  data  input  file. 


Parameter  Definitions 


Since  the  control  criterion  is  the  only  parameter  that 
can  change  between  iterations,  subroutine  ENDIT  changes  only 
PARAM (8,1) , the  SAINT  variable  defining  the  control  criterion. 
The  value  is  input  as  0 and  ENDIT  changes  it  to  250,  500, 

750,  and  1000  after  iterations  4,  8,  12,  and  16,  respectively. 


SPSS  Format 


The  control  cards  for  SPSS  for  the  scattergram  analysis 
are  prepared  in  the  same  manner  as  those  of  the  ANOVA  analysis. 


Data  Input 

The  data  input  for  the  scattergram  analysis  is  computed 
and  output  to  file  NOTPT  after  each  iteration.  For  each 
iteration,  one  data  card  is  prepared  which  contains  the 
following  information: 

Data  Card  Columns  Value 

1-10  Average  linear  deviation 

11-15  Control  criterion 
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Subroutine  ENDIT  determines  the  appropriate  values  for  the 
iteration  and  then  outputs  them  in  SPSS  format.  The  appro- 
priate level  for  the  control  criterion  is  determined 
directly  from  the  iteration  number.  The  average  linear 
deviation,  as  before,  is  computed  by  dividing  US0BV(1,1)  by 
USOBV (1,3) . 

Subroutine  ENDIT  also  reports  and  clears  the  statisti- 
cal storage  arrays.  The  FORTRAN  listing  of  subroutine  ENDIT 
for  the  scattergram  analysis  is  given  in  Figure  12. 


Results 

The  SAINT  model  was  executed  for  the  twenty  iterations 
discussed  above.  The  output  written  to  file  NOTPT  is  pre- 
sented in  Figure  13.  This  output  is  then  directly  input  to 
the  SPSS  statistical  routines  for  analysis. 

The  results  of  the  SPSS  scattergram  analysis  is  given 
in  Figure  14.  The  average  linear  distance  from  the  target 
is  plotted  against  the  control  criterion  used.  These 
results  indicate  that  mission  performance  deteriorates  as 
the  control  criterion  is  increased.  Assuming  that  an  aver- 
age of  350  feet  of  deviation  is  acceptable,  the  following 
table  presents  the  percentage  of  iterations  whose  perform- 
ance was  acceptable  for  each  control  criterion. 


Control  Criterion  Percent  Acceptable 


0 

100 

250 

50 

500 

25 

750 

0 

1000 

0 

Since  the  mission  requires  approximately  ten  minutes 
from  start  to  completion  (all  RPVs  have  achieved  target) , 
it  does  not  seem  excessive  to  require  that  the  operator 
patch  the  RPVs  continuously.  And  since  the  above  results 
indicate  that  mission  performance  will  be  significantly  im- 
proved by  this  procedure,  this  procedure  will  be  employed. 
Therefore,  the  RPV  system  definition  now  includes  the  use 
of  navigation  system  B and  control  criterion  0.  Further 
analysis  will  only  be  performed  using  this  system. 
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mis  PAGE  IS  BEST  QUALITY  PRACTICABLE 
raon  COPY  FURNISHED  TO  


SUBRCcTI ME  EfCIT  (ITEP.l 

COMMON  /CCM3  9/  i I .NPTBU  (100)  ,F  151 1 11 SC ) .PAR  1-1  ICO) 

COMMON  /CCri23/  LLUGC  (23,2)  . UE06V(  2 0.S  ) .LLUGT  (23,2) , T TCuA ( 20  ) , 

• USTp  V(23,a  > , LLU3H (20,2)  , NNCEt.  (23) ,HHLOW(20 ) , 

• HhwIJ(23>  , JJCELCCC) 

N0TPT=7 

IFilTER.GT. 1)  GO  TO  EGO 

WRITE  SPSS  CONTROL  CAROS. 

WR1T£(N0TFT (130) 

WRITE (NOTCT. 1311 
WRITE (HOTPT i 132) 

WRITE (MOTPT ,10  3) 

WRITt (NCTkT  , 104) 

WRITE! NOT  FT  >131) 

WRITE ( NCTFT , 1 jt) 

1G0  FORMAT  C sHRUN  NAME.7X.20HS..INT-SPS'  EXAMPLE  2) 

131  FORMAT H3MVAxiAbLi  Li  ST  , 2X , 1 3HT- R GET  NFATCh) 

102  FORMAT ( 12HINPUT  MEOIUM , 3X , 4 HCARO > 

103  FORMA  T ( 1 3H.,  OF  CAGES.  rX.’HJJ) 

104  FORMAT (12HINPUT  FORMAT , 3 X , 1* MFI X E D < F 1 0 . 3 ,R S . 3 ) I 

105  FORMAT ( 11 HSS  ATTEkGR Ail , 4X  , 39mTARGET(0. , 23C3. 1 hITh  Mr ATC H ( 3 . . 1 C 3 0 . ) 
•/) 

1C6  FORMAT ( lOHRiAO  INPUT) 

107  FORMAT  (bHFINISH) 

OETEKHMc  CONTROL  CRITERION 
USED  FOR  THE  LAST  ITlRATIO.N. 

500  GO  TO  (1.1.1.1.2t2.2t2t3t3t  + .ITER 

1 NPAT  = 0 
GO  TO  b 

2 NPAT s 25  0 
GO  TO  b 

3 NPAT *; u 3 
GO  TO  fc 

4 NPAT  = i E 0 
GO  TO  c 

5 NPAT= 1030 

COMPUTE  THE  AVERAGE  clNEAP.  DISTANCE  FmJm  ThE  '1FGET  FOR 
THIS  ITEaATIlN  AMO  PRINT  CUT  THl  SfiS  DATA  CARO  FOR  ThIS 
ITERATION. 

6 AVGsUi03V  (1 .1 ) 7USC3V  (1,3) 

WRITE  (NOTFT  . 10b)  AVi.'.PAT 

108  FORMAT (FIS. 3,15) 

CAUSE  SAINT  TO  REPORT  ON  ALL  'JSEr.  COLLECTED  STATISTICS 
FOR  THIS  ITlhATIC  ( • OLE-R  THESE  STATISTICAL  STORAGE 
ARRAYS  for  The  NEXT  ITERATION. 

CALL  CCLCT(1.,C> 

CALL  UHISTI1..C) 

CALL  CLEAR 

SET  The  PARAMETER  V-LUSS  That  ARE  A P°l I Sfc SL E pCR  The 
I. ext  ITERATION.  PRINT  CUT  THE  SPSS  xFImISi*  CA^D  IF 
this  was  the  last  iteration. 


Figure  12(1). 


FORTRAN  Listing  of  Subroutine  ENDIT 
for  the  Scattergram  Analysis. 
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GO  TO  (1:?. 1 5. ls.lG.l... 15. 15.11.15.1 ‘*'.15.12.1.'  1;  * 1 *• 

•) .ITER 

1C  PARA«(3, 1>=25G. 

GO  TO  13 

11  PARAM(6'1)=>C3. 

GO  TO  13 

12  PARAM ( 3 1 1 > = 75 u . 

GO  TG  15 

13  PARAM (3.1 >=1CG0. 

GO  TO  15 

14  WRITt(NOTPT.lu7l 

15  RETURN 
ENO 


Figure  12(2).  FORTRAN  Listing  of  Subroutine  ENDIT 
for  the  Scattergram  Analysis. 
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■MN 


"V*  ***■ 


THIS  PAGE  IS  BEST  QU 


[Alin  FRACTICABia 


SAtflT-SPSS  EXA  iPt  5 2 
TARGET  NPATCH 
CARD 
20 

PKiO  ifl0.3»  = 5.  0» 

TA RGcT ( Q , , 2 000  » I WITH  HP«TGH  10  . , 1C 00 . I / 


320. 78-, 

J 

240.560 

0 

234.272 

0 

181. 92E 

c 

235.359 

250 

682.232 

250 

758.978 

250 

199. 5s3 

250 

289.374 

ECO 

413.473 

500 

1122.990 

900 

390.421 

S 00 

716. 9b5 

750 

fcl 5 • 70  5 

750 

1242.892 

750 

780.895 

75  0 

577.265 

1000 

775.692 

1000 

839. 2 >.6 

1000 

672.964 

1000 

FINISH 


RUN  NAME 
VARIABLE  LIST 
INPUT  ME01UM 
N OF  CASES 
INPUT  FORMAT 

scattergram 

READ  INPUT 


Figure  13.  Listing  of  Output  Written  to  File  NOTPT 
for  the  Scattergram  Analysis. 


SCAfICftGRAH  Of  IOOMNI  J kHiif  UJSCSSI  NPATCH 


Figure  14.  Results  of  the  SPSS  Scattergram  Analysis. 


Regression  and  Correlation  Analyses 


The  analyses  performed  above  have  determined  that  the 
RPV  system  will  be  composed  of  RPVs  with  inertial  naviga- 
tion systems  and  an  operating  procedure  that  dictates  that 
the  operator  continuously  patch  the  RPVs  in  flight.  This 
system  was  examined  1)  to  determine  what  effect  operator 
conscientiousness  (as  defined  by  the  probability  that  he 
will  patch  an  RPV  when  so  required)  has  on  mission  perform- 
ance; and  2)  to  discover  if  the  lateral  deviation  and  ground 
speed  deviations  collected  as  the  mission  progresses  can  be 
used  as  indicators  of  mission  performance.  Since  both 
analyses  consider  the  same  basic  system,  the  same  iterations 
were  used  for  both. 

Four  values  of  the  operator's  patching  probability 
were  examined.  Four  replications  for  each  probability  were 
made.  The  sixteen  iterations  are  defined  as  follows: 


Iteration  Number  Patching  Probability 


1-4 

1.0 

5-8 

0.8 

9-12 

0.6 

13-16 

0.4 

A regression  was  performed  to  assess  a hypothesized 
linear  relationship  between  the  average  linear  deviation  and 
the  patching  probability.  After  the  regression  analysis,  a 
Pearson  correlation  analysis  was  employed  to  determine  the 
relationships  between  1)  the  average  linear  distance, 

2)  the  average  ground  course  error  of  the  RPVs,  and  3)  the 
average  ground  speed  error  of  the  RPVs. 

As  in  the  previous  examples.  Subroutine  ENDIT  defines 
the  parameters  for  each  iteration,  prepares  the  SPSS  control 
cards,  and  creates  the  SPSS  data  input. 


Parameter  Definitions 


Since  the  probability  of  patching  is  the  only  parameter 
that  can  change  between  iterations , subroutine  ENDIT  changes 
only  PARAM (5,1) , the  SAINT  variable  defining  the  probabil- 
ity of  patching.  The  value  is  input  as  1.0  and  ENDIT 
changes  the  value  to  0.8,  0.6,  and  0.4  after  iterations  4, 

8,  and  12,  respectively. 
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SPSS  Format 


Since  two  analyses  were  performed  using  the  same  data 
set,  the  SPSS  control  cards  were  printed  in  a different  order 
than  previously  used.  The  procedure  cards  for  the  second 
l analysis  to  be  performed  follow  the  data  input.  Thus,  sub- 

routine ENDIT  processes  the  SPSS  control  cards  and  the  SPSS 
procedure  cards  for  the  regression  analysis  after  the  first 
iteration.  The  procedure  cards  for  the  Pearson  correlation 
are  processed  after  the  last  iteration  (just  prior  to  the 
FINISH  card) . 


i 

1 

i 

i 


Data  Input 

The  data  required  for  both  analyses  performed  is  output 
to  file  NOTPT  at  the  end  of  each  iteration.  The  data  card 
prepared  for  each  iteration  is  of  the  following  format: 


Data  Card  Columns 
1-10 
11-20 
21-30 
31-40 


Value 
t 

I Average  linear  deviation 
Patching  probability 
Average  ground  course  error 
Average  ground  speed  error 


Subroutine  ENDIT  determines  the  appropriate  values  for  the 
iteration  and  then  outputs  them  in  the  above  format.  The 
patching  probability  is  determined  directly  from  the  iter- 
ation number.  The  other  values  require  calculation  by  sub- 
routine ENDIT. 

For  each  iteration,  the  deviation  of  each  RPV  from  the 
target  at  the  time  it  delivers  its  payload  is  collected  in 
user-statistic  1.  The  ground  course  and  ground  speed  errors 
of  all  RPVs  are  collected  every  five  seconds  in  user- 
statistics  2 and  3,  respectively.  Since  SAINT  variables 
USOBV (1,1)  and  US0BV(I,3)  represent,  respectively,  the  sum 
of  the  observations  collected  and  the  number  of  observa- 
tions collected  for  user-statistic  I,  the  average  values 
are  computed  by: 


Average  = 


USOBV (1,1) 
USOBV (1,3) 
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As  in  the  previous  analyses,  subroutine  ENDIT  also 
reports  the  user-collected  statistics  and  clears  the  sta- 
tistical storage  for  the  next  iteration.  The  FORTRAN  list- 
ing of  subroutine  ENDIT  for  the  regression  and  correlation 
analyses  is  given  in  Figure  15. 

I 

: 

» SAINT  Output 

> The  SAINT  model  was  executed  for  the  sixteen  iterations 

discussed  above.  The  output  written  to  file  NOTPT  is  pre- 
sented in  Figure  16.  This  output  is  input  to  the  SPSS  sta- 
tistical routines  for  analysis. 


Regression  Results 

The  results  of  the  SPSS  regression  analysis  are  given 
in  Figure  17.  If  there  is  a linear  relationship  between  the 
average  linear  distance  and  the  probability  of  patching 
(between  the  range  of  0.4  and  1.0),  then  the  best  estimate 
of  this  relation  is: 

TARGET  = 462  - 252  * PPATCH 


where : 

TARGET  = average  linear  distance 
PPATCH  = probability  of  patching. 


1 

l 


I 


1 


The  results  indicate  that  there  is  a statistically  sig- 
nificant difference,  in  terms  of  mission  performance,  between 
patching  probabilities  (level  = .024)  and  that  there  is  a 
95  percent  confidence  that  the  coefficient  of  PATCH  is 
between  -466  and  -39.  Thus,  mission  performance  improves 
(TARGET  increases)  as  operator  conscientiousness  (as  de- 
fined by  the  probability  of  patching)  increases. 

The  results  also  estimate  that  32  percent  (R  SQUARE)  of 
the  variation  in  TARGET  is  explained  by  PATCH.  If  the 
assumption  of  a linear  relation  between  TARGET  and  PPATCH 
is  correct,  the  analysis  of  our  model's  output  suggests  that 
68  percent  of  the  variation  in  TARGET  is  caused  by  the  ran- 
domness inherent  in  the  system  (the  random  variation  of  the 
navigation  systems) . 
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Tms  page  is  best  quality  practicable 

Cvr  3 1 PUhAl.SHKTl  jq  ppg 


SUERLUTIDE  ENDIT (ITER) 

COMMON  /CC.13-J/  P«RAM<  133  . ;)  ,t.PT3U)l03l  ,FAR  " 1 ( 1 C „ » . »A  = • A ( 1 00  ) 
COMMON  /CCM23/  LLUGC  (23 « 2 > . USC 9W ( 20 , 1 > , LLUGT ( 23 , 2 > , TT I lR  ( 23 ) . 

U3TPV  (20.0  ) . LL  UGH (23*2*  ,(..NC£l  (20)  , HMLOW  < 20  ) , 
hhwU  (231  , JJCc.L(-.>-CI 

N01PTs7 

IF)IT£F.GT. 1>  GO  TO  333 


WRITE  SPSS  COhTRO.  *„RCS. 


WRITE (nOTPT  ,130) 

WRITE) HOT PT, 101) 

HRITEC.CTFT  ,102) 

WRITE  ("40TPT , 1C  3) 

WRIT£(nOTFT,13-> 

WRITE(NCTFT  ,10!.) 

WRITE  tf.CTFT,  11C) 

WRITE  I iCTFT, 139) 

WRITE  (i4  0TPT,13e) 

100  FORMAT  ( iHF.Ut)  H AM£  ,7  X , ’ 3 HI *1  NT-SPSS  £< A IF  LE  3) 

101  FCRI'AT  ( l3hO«R»A9uE  LIST,  2 X , 2LHTAR&ET  F=A7L"  OCRS  ‘.SPED) 

102  FORMAT ( 12MIIPUT  MiO I'J  1 , 3 a , <•  hC-RD ) 

103  FORMAT  ( 13  Hf,  JF  CASE  a , : X , 2 H 1 s I 

10L  FORMAT  (12hInFUT  FlRM„  T , 3X  , 3 1 HFI  X£  C ( F 1 0 . 3 , c 1 3 . 3 , F 1 0 . 3 , F 10 . 3 ) ) 

105  FORMAT)  1CHREGRfssIC.'),-*,2c.MVARIA3lES  a T»F3i7  F=hT;h/> 

109  FORMAT  <13hSTATISTIC3*>X,3hALl) 

110  FORMAT  (lax,  3 GHRt GRE 351 JN  = T^-.GET  WITH  FPATC  rt  ( 2 I / ) 

10b  FORMAT ( 1C  WREAO  INPUT) 

107  FORMAT (ertFIMIGH) 

DETERMINE  OPERATOR  =-TCHI.)G  FRC3- 3 XL  IT  Y 
USED  FOR  THE  LAST  ITERATION. 

500  GO  TO  ( 1 , 1 , 1 , 1 , 2 , 2 , 2 , 2 , 3 , 3 , 3 , J,  A , «• , - ) , 2 Tz  R 

1 PPaTCh»1.G 
GO  TO  ,-i 

2 PPaTCh* 0 , o 
GO  TO  t 

3 PPATChsJ.c 
GO  TO  5 

A PP**TCh  = 0 • l 

SOHPoTE  ThE  AVERAGE  uINEm.R  DISTANCE  FRO*  Th£  7 A - 3 £ 7 PC3 
This  ITERATION  AND  PRINT  OUT  THE  SPSS  J-IA  CARD  rD^  This 
ITERATION. 

5 AvGaUSCE/ll  ,1>/U3C3V(1,3) 

AwGlaUSOSVl 2, D/US08V 12, 3 ) 

AVG2=US03V( 3,1)/ USD  33(3,2) 

WRITE (DO TFT ,133)  A VG, =3 h 7 CH , * VG1 , A VG2 

108  FORMAT (-F10. 3 ) 

CAUSl  3-INT  TD  REPORT  DN  All  JSEt  COLLECTED  STATISTICS 
FOR  THIS  ITERATION.  3lE-R  THESE  STATISTICAL  STORAGE 
ARRAYS  FuR  The  .*,l  XT  ITEhmTI07. 

CALL  JLL0T(1.,3) 

CALL  UHIST ( 1 • , 3 > 

CALL  sLEAP 

C 

i 

t 

J 

Figure  15(1).  FORTRAN  Listing  of  Subroutine  ENDIT  for 
the  Regression  and  Correlation  Analyses. 
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anno 


THIS  PAGE  IS  BEST  QUALITY  PRACTICABLE 
JRKM4  COrY  FUmUSttiiD  TO  DflC  


GET  The  PARAMETER  i/AL'JES  THAT  AR-  -PPl.:„A3Li  J0P  Th-_ 

NEXT  ITERATION.  3-i;.<T  CUT  THE  jfSi  *FEr..SH*  ca^;  :« 

ThIS  HAS  TH£  CAST  ITERATION. 

GO  TO  ( 10  ,13.10.8.10.10,  13.7 . 10, 1G,  13 . 3,  1C,  10, 1C.  31  , ITE- 

6 PAAAM  <5 ,1  > = 3.  3 
GO  TG  13 

7 FAKAN  <•  ,l)s3.E 
GO  TO  13 

8 FARAMC3.1)*].., 

GO  TO  10 

9 WRITE  <NCTPT, 112) 

WRI TE I NOT  FT  »111) 

WRITE  < NOT  FT » 109) 

WRITE  (NOTFT  . 107) 

112  FORMAT  (12HP£a*SOH  C GRP , 3 X , t,  OhT  AF  GET  GC'3  GEP-.C  WITH  TARGET  OCRS  GS 

•PEO) 

111  FORMAT ( 7H0? T1GU3 , iX , i« J ) 

10  RETURN 
END 


Figure  15(2).  FORTRAN  Listing  of  Subroutine  ENDIT  for 
the  Regression  and  Correlation  Analyses. 
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RUN  N4M£  SAINT-SPSS  EXAMPLE  3 

VARIABLE  LIST  TARGET  PPATCh  GSRS  GSPEO 

INPUT  HEDIUH  CARO 

N OF  CASES  16 

INPUT  FORMAT  FIXED  |fr10.3,r13.  3,F:0.3,Fi3,3) 
REGRESSION  VARIABLES  = TARGET  PPATCH/ 

REGRESSION  a TARGET  WITH  PPATCH I 2 > / 


STATISTICS  ALL 

READ  INPUT 


32G .76* 

1 . 0 0 G 

93.319 

.30  1 

24G. 5oo 

1.300 

5 9.  33  3 

• 00  7 

23  A. 272 

1.000 

97. =26 

.006 

181.926 

1.  J 0 J 

59.323 

.G  06 

26  3.0  20 

.303 

3 7 . T 3 9 

.006 

218.405 

.80  0 

103.999 

.00  6 

278.011 

. iGC 

92.r7J 

.00  1 

149.391 

.900 

7,.  333 

.006 

160.325 

* 6 o 3 

9-..  530 

.004 

307.502 

.900 

132. 536 

.00  6 

372.765 

.903 

146.363 

.00  3 

237.656 

. 69  C 

137.331 

• oaf 

229.397 

.->00 

121.993 

.033 

4/  3.  541 

. f00 

144.993 

.004 

392.723 

.433 

163. j39 

.00  3 

49  6.728 

.400 

23  5. 611 

.002 

PEARSON  CORn 

TARGET 

GCRS  GS3£J 

WITH  Ti: 

OPTIONS 

3 

STATISTICS 

All 

FINISH 


Figure  16.  Listing  of  Output  Written  to  File  NOTPT  for 
the  Regression  and  Correlation  Analyses. 
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Figure  17.  Results  of  the  SPSS  Regression  Analysis 


Pearson  Correlation  Results 


The  results  of  the  SPSS  Pearson  correlation  analysis 
are  given  in  Figure  18.  These  results  indicate  that  there 
are  statistically  significant  correlations  (at  the  0.05 
level)  for  the  following  comparisons: 


TARGET  vs.  GCRS 
TARGET  VS.  GSPED 
GCRS  VS.  GSPED 


where : 

TARGET  = average  linear  distance 
GCRS  = average  ground  course  error 
GSPED  = average  ground  speed  error 


The  positive  correlation  (0.79)  between  TARGET  and  GCRS  sug- 
gests that  the  average  ground  course  error  might  be  used  as 
an  effective  measure  of  performance  if  statistics  on  TARGET 
are  not  available  (if  GCRS  is  low  then  TARGET  will  also  be 
low)  . 


The  GSPED-TARGET  and  GSPED-GCRS  correlations  are  highly 
negative  (-.66,  -.74).  This  suggests  that  the  ground  speed 
error  might  also  be  used  as  an  effective  measure  of  per- 
formance (if  GSPED  is  high  then  TARGET  will  be  low) . How- 
ever, since  the  ground  speed  error  is  recomputed  after  a 
patch,  care  should  be  taken  when  using  this  correlation. 

This  would  especially  be  true  if  RPV  times  of  arrival  at 
the  target  were  included  in  the  model  as  secondary  perform- 
ance measures. 
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SECTION  VII 


CONCLUSION 


An  RPV/DCF  system  in  which  five  RPVs  fly  along  a flight 
path  to  a target  under  the  control  of  a single  operator 
DCF  has  been  hypothesized.  A SAINT  model  of  this  system  has 
been  developed  and  executed.  The  results  of  the  execution 
of  the  SAINT  model  have  been  prepared  by  subroutine  ENDIT 
for  input  to  the  SPSS  statistical  routines.  With  this 
input,  the  SPSS  package  has  been  used  to  perform  statisti- 
cal analyses  on  the  results  of  the  execution  of  the  SAINT 
model. 

This  report  has  described  the  above  process  to 
illustrate  the  methodology  required  for  the  construction  of 
a SAINT-SPSS  interface.  This  methodology  could  be  applied 
to  any  other  output  of  a SAINT  simulation  (e.g.,  task 
statistics  or  state  variable  statistics)  and  to  any  of  the 
other  SPSS  analysis  procedures  (e.g.,  descriptive  statis- 
tics or  factor  analysis).  Thus,  by  employing  this  method- 
ology, the  SAINT  user  has  the  capability  to  analyze  his 
simulation  results  using  an  external  statistical  analysis 
package. 
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APPENDIX  A 


SAINT  MODEL  INPUT 


The  following  pages  list  the  data  input  used  for  the 
execution  of  the  SAINT  model  of  the  RPV/DCF  system.  Be- 
tween executions  for  different  analyses,  only  the  number  of 
iterations  and  the  values  of  distribution  set  parameters 
varied  (as  explained  in  the  text) . 
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APPENDIX  B 

r. v 

SAINT  DATA  ECHO  CHECK 


i 


I 

i 


The  following  pages  present  the  echo  check  of  the 
SAINT  model  input  listed  in  Appendix  A. 
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APPENDIX  C 
EXAMPLE  OUTPUT 


This  appendix  presents  output  from  one  iteration  of  the 
SAINT  model  of  the  RPV/DCF  system  described  in  this  report. 
This  output  consists  of: 

1.  The  user-generated  statistics  collected  for 
the  iteration,  and 

2.  The  user-generated  histograms  created  for  the 
iteration. 
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